Jul 03 23:41:55 devstack cinder-volume[75433]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 23:41:55 devstack cinder-volume[75433]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 23:41:55 devstack cinder-volume[75433]: we strongly recommend against using it for new projects. Jul 03 23:41:55 devstack cinder-volume[75433]: If you are already using Eventlet, we recommend migrating to a different Jul 03 23:41:55 devstack cinder-volume[75433]: framework. For more detail see Jul 03 23:41:55 devstack cinder-volume[75433]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 23:41:55 devstack cinder-volume[75433]: import eventlet # noqa Jul 03 23:41:58 devstack cinder-volume[75433]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75433) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 23:41:58 devstack cinder-volume[75433]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75433) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 23:41:58 devstack cinder-volume[75433]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75433) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 23:41:59 devstack cinder-volume[75433]: INFO dbcounter [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Registered counter for database cinder Jul 03 23:41:59 devstack cinder-volume[75433]: DEBUG oslo_db.sqlalchemy.engines [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75433) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 23:41:59 devstack cinder-volume[75433]: DEBUG dbcounter [-] [75433] Writer thread running {{(pid=75433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 23:41:59 devstack cinder-volume[75433]: INFO cinder.rpc [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 23:41:59 devstack cinder-volume[75433]: INFO cinder.rpc [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 23:41:59 devstack cinder-volume[75433]: DEBUG oslo_db.sqlalchemy.engines [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75433) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 23:41:59 devstack cinder-volume[75433]: INFO cinder.volume.manager [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Determined volume DB was empty at startup. Jul 03 23:41:59 devstack cinder-volume[75433]: DEBUG cinder.volume.manager [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75433) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 03 23:41:59 devstack cinder-volume[75433]: INFO cinder.volume.manager [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 03 23:41:59 devstack cinder-volume[75433]: WARNING stevedore.named [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 23:41:59 devstack cinder-volume[75433]: WARNING castellan.key_manager [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 23:41:59 devstack cinder-volume[75433]: WARNING cinder.keymgr.conf_key_mgr [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 23:41:59 devstack cinder-volume[75433]: DEBUG cinder.volume.drivers.lvm [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75433) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 03 23:41:59 devstack cinder-volume[75433]: DEBUG oslo_concurrency.processutils [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_concurrency.processutils [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] CMD "cinder-rtstool verify" returned: 0 in 0.639s {{(pid=75433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_db.sqlalchemy.engines [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75433) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 23:42:00 devstack cinder-volume[75433]: INFO cinder.rpc [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 03 23:42:00 devstack cinder-volume[75433]: INFO cinder.rpc [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 03 23:42:00 devstack cinder-volume[75433]: WARNING stevedore.named [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 23:42:00 devstack cinder-volume[75433]: WARNING castellan.key_manager [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 23:42:00 devstack cinder-volume[75433]: INFO cinder.volume.manager [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_db.sqlalchemy.engines [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75433) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 23:42:00 devstack cinder-volume[75433]: INFO oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Starting 1 workers Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Started child 75607 {{(pid=75433) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Full set of CONF: {{(pid=75433) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] ******************************************************************************** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Configuration options gathered from: {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] ================================================================================ {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] allow_availability_zone_fallback = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] allow_compression_on_image_upload = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] allowed_direct_url_schemes = [] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] api_rate_limit = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75607]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] auth_strategy = keystone {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] az_cache_duration = 3600 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_availability_zone = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_host = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_name = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_stats_polling_interval = 60 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backup_api_class = cinder.backup.api.API {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backup_name_template = backup-%s {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backup_use_same_host = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backup_use_temp_snapshot = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] chap_password = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] chap_username = {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cinder_internal_tenant_project_id = 5249c90969674218bacee2631489c28d {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cinder_internal_tenant_user_id = fcec216b683f4cdeafd93a3159aaed19 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cloned_volume_same_az = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cluster = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] compression_format = gzip {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] compute_api_class = cinder.compute.nova.API {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] config_dir = [] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] config_source = [] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] control_exchange = openstack {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] debug = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] default_availability_zone = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] default_group_type = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] default_volume_type = lvmdriver-1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] disk_geometry = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] driver_client_cert = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] driver_client_cert_key = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] driver_data_namespace = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] driver_ssl_cert_path = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] driver_ssl_cert_verify = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] driver_use_ssl = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] enable_force_upload = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] enable_new_services = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] enable_unsupported_driver = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] enforce_multipath_for_image_xfer = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] filter_function = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance_api_insecure = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance_api_servers = ['http://192.168.122.153/image'] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance_api_ssl_compression = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance_ca_certificates_file = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance_catalog_info = image:glance:publicURL {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance_certfile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance_keyfile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance_num_retries = 3 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance_request_timeout = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] goodness_function = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] graceful_shutdown_timeout = 5 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] group_api_class = cinder.group.api.API {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] host = devstack {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] image_compress_on_upload = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] image_conversion_address_space_limit = 1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] image_conversion_cpu_limit = 60 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] image_conversion_disable = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] image_upload_use_cinder_backend = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] image_upload_use_internal_tenant = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] image_volume_cache_enabled = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] image_volume_cache_max_count = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] image_volume_cache_max_size_gb = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] init_host_max_objects_retrieval = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] instance_format = [instance: %(uuid)s] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] iscsi_target_flags = {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75607]: INFO cinder.volume.manager [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] iscsi_write_cache = on {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] iser_helper = tgtadm {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] iser_ip_address = 192.168.122.153 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] iser_port = 3260 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] log_color = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] log_config_append = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] log_dir = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] log_file = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] log_options = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] log_rotate_interval = 1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] log_rotate_interval_type = days {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] log_rotation_type = none {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] max_age = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] max_logfile_count = 30 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] max_logfile_size_mb = 200 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] max_over_subscription_ratio = 20.0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] message_reap_interval = 86400 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] message_ttl = 2592000 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] migration_create_volume_timeout_secs = 300 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] monkey_patch = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] monkey_patch_modules = [] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] my_ip = 192.168.122.153 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] no_snapshot_gb_quota = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] num_iser_scan_tries = 3 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] num_shell_tries = 3 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] num_volume_device_scan_tries = 3 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] nvmeof_conn_info_version = 1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] nvmet_ns_id = 10 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] nvmet_port_id = 1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] osapi_max_limit = 1000 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] osapi_volume_ext_list = [] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] osapi_volume_listen_port = 8776 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] osapi_volume_use_ssl = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] osapi_volume_workers = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] per_volume_size_limit = -1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] periodic_fuzzy_delay = 60 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] periodic_interval = 60 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] public_endpoint = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] publish_errors = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] quota_backup_gigabytes = 1000 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] quota_backups = 10 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] quota_gigabytes = 1000 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] quota_groups = 10 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] quota_snapshots = 10 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] quota_volumes = 10 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] rate_limit_burst = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] rate_limit_except_level = CRITICAL {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] rate_limit_interval = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] reinit_driver_count = 3 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] replication_device = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] report_discard_supported = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] report_interval = 120 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] reservation_clean_interval = 86400 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] reservation_expire = 86400 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] reserved_image_namespaces = [] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] reserved_percentage = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] rpc_response_timeout = 120 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] run_external_periodic_tasks = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] scst_target_driver = iscsi {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] scst_target_iqn_name = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] service_down_time = 720 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] shell_completion = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] snapshot_name_template = snapshot-%s {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] snapshot_same_host = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] split_loggers = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] state_path = /opt/stack/data/cinder {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] storage_availability_zone = nova {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] storage_protocol = iSCSI {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] syslog_log_facility = LOG_USER {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] target_helper = lioadm {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] target_ip_address = 192.168.122.153 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] target_port = 3260 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] target_protocol = iscsi {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] target_secondary_ip_addresses = [] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] trace_flags = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] transport_url = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] until_refresh = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] use_chap_auth = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] use_default_quota_class = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] use_journal = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] use_json = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] use_multipath_for_image_xfer = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] use_stderr = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] use_syslog = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] verify_glance_signatures = enabled {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] volume_api_class = cinder.volume.api.API {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] volume_backend_name = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] volume_clear = zero {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] volume_clear_ionice = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] volume_clear_size = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] volume_copy_bps_limit = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] volume_dd_blocksize = 1M {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] volume_name_template = volume-%s {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] volume_service_inithost_offload = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] volume_usage_audit_period = month {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] zoning_mode = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_concurrency.disable_process_locking = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack sudo[75611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack sudo[75611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.auth_section = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.auth_type = password {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.auth_version = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.cache = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.certfile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.include_service_catalog = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.insecure = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.interface = public {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.keyfile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.memcache_password = {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.memcache_username = {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.region_name = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.service_type = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.153/identity {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.backend = dogpile.cache.null {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.backend_argument = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.backend_expiration_time = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.config_prefix = cache.oslo {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.debug_cache_backend = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.enable_retry_client = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.enable_socket_keepalive = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.enabled = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.expiration_time = 600 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.hashclient_retry_attempts = 2 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.memcache_dead_retry = 300 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.memcache_pool_maxsize = 10 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.memcache_sasl_enabled = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.password = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.proxies = [] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.redis_db = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.redis_server = localhost:6379 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.retry_attempts = 2 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.retry_delay = 0.0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.socket_keepalive_count = 1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.socket_keepalive_idle = 1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.socket_keepalive_interval = 1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.socket_timeout = 1.0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.tls_allowed_ciphers = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.tls_cafile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.tls_certfile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.tls_enabled = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.tls_keyfile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cache.username = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.asyncio_connection = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.asyncio_slave_connection = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.backend = sqlalchemy {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.connection = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.connection_debug = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.connection_parameters = {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.connection_recycle_time = 3600 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.connection_trace = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.db_inc_retry_interval = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.db_max_retries = 20 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.db_max_retry_interval = 10 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.db_retry_interval = 1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.max_overflow = 50 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.max_pool_size = 5 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.max_retries = 10 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.mysql_wsrep_sync_wait = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.pool_timeout = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.retry_interval = 10 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.slave_connection = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.sqlite_synchronous = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.synchronous_reader = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] database.use_db_reconnect = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] profiler.connection_string = messaging:// {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] profiler.enabled = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] profiler.es_doc_type = notification {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] profiler.es_scroll_size = 10000 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] profiler.es_scroll_time = 2m {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] profiler.filter_error_trace = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] profiler.hmac_keys = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] profiler.sentinel_service_name = mymaster {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] profiler.socket_timeout = 0.1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] profiler.trace_requests = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] profiler.trace_sqlalchemy = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] profiler_jaeger.process_tags = {} {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] profiler_jaeger.service_name_prefix = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] profiler_otlp.service_name_prefix = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_policy.enforce_new_defaults = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_policy.enforce_scope = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_policy.policy_default_rule = default {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_policy.policy_file = policy.yaml {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] coordination.backend_url = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] privsep_osbrick.group = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] privsep_osbrick.helper_command = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] privsep_osbrick.user = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cinder_sys_admin.group = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cinder_sys_admin.helper_command = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] cinder_sys_admin.user = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] service_user.auth_section = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] service_user.auth_type = password {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] service_user.cafile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] service_user.certfile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] service_user.collect_timing = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] service_user.insecure = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] service_user.keyfile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] service_user.send_service_user_token = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] service_user.split_loggers = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] service_user.timeout = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance.auth_section = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance.auth_type = password {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance.certfile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance.collect_timing = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance.insecure = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance.keyfile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance.region_name = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance.split_loggers = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] glance.timeout = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.backend_availability_zone = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.chap_password = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.chap_username = {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.disk_geometry = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.driver_client_cert = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.driver_client_cert_key = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.driver_data_namespace = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.driver_use_ssl = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.extra_capabilities = {} {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.filter_function = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.goodness_function = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.iscsi_target_flags = {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.iscsi_write_cache = on {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.iser_helper = tgtadm {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.iser_ip_address = 192.168.122.153 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.iser_port = 3260 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.lvm_share_target = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.lvm_type = auto {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.num_shell_tries = 3 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.replication_device = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.report_discard_supported = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.reserved_percentage = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.target_helper = tgtadm {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.target_ip_address = 192.168.122.153 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.target_port = 3260 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.target_protocol = iscsi {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.trace_flags = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.unique_fqdn_network = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.use_chap_auth = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.volume_backend_name = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.volume_clear = zero {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.volume_clear_ionice = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.volume_clear_size = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_reports.file_event_handler = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_reports.log_dir = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.backend_host = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.chap_password = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.chap_username = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.disk_geometry = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.driver_client_cert = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.extra_capabilities = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.filter_function = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.goodness_function = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.iser_helper = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.iser_ip_address = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.iser_port = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.lvm_share_target = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.lvm_type = auto {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.num_shell_tries = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.replication_device = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.report_discard_supported = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.reserved_percentage = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.scst_target_driver = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.storage_protocol = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.target_helper = lioadm {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.target_ip_address = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.target_port = 3260 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.trace_flags = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.use_chap_auth = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.volume_clear = zero {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.volume_clear_size = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] lvmdriver-1.volumes_dir = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.ssl = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_notifications.driver = [] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_notifications.retry = -1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] key_manager.fixed_key = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican.barbican_api_version = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican.barbican_endpoint = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican.barbican_endpoint_type = public {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican.barbican_region_name = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican.cafile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican.certfile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican.collect_timing = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican.insecure = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican.keyfile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican.number_of_retries = 60 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican.retry_delay = 1 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican.send_service_user_token = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican.split_loggers = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican.timeout = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican.verify_ssl = True {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican.verify_ssl_path = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican_service_user.auth_section = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican_service_user.auth_type = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican_service_user.cafile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican_service_user.certfile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican_service_user.collect_timing = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican_service_user.insecure = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican_service_user.keyfile = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican_service_user.split_loggers = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] barbican_service_user.timeout = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] vault.approle_role_id = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] vault.approle_secret_id = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] vault.kv_mountpoint = secret {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] vault.kv_path = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] vault.kv_version = 2 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] vault.namespace = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] vault.root_token_id = **** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] vault.ssl_ca_crt_file = None {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] vault.timeout = 60.0 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] vault.use_ssl = False {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:42:00 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] ******************************************************************************** {{(pid=75433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 23:42:01 devstack sudo[75611]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:01 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.810s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:01 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:01 devstack sudo[75723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 23:42:01 devstack sudo[75723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:02 devstack sudo[75723]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:02 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.753s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:02 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 23:42:02 devstack cinder-volume[75607]: INFO cinder.brick.local_dev.lvm [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 03 23:42:02 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:02 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:02 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:02 devstack sudo[75996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 23:42:02 devstack sudo[75996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:03 devstack sudo[75996]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:03 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.704s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:03 devstack cinder-volume[75607]: DEBUG cinder.brick.local_dev.lvm [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75607) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 03 23:42:03 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:03 devstack sudo[76177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 23:42:03 devstack sudo[76177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:04 devstack sudo[76177]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:04 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.117s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:04 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:04 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:04 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:04 devstack sudo[76372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 23:42:04 devstack sudo[76372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:04 devstack sudo[76372]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:04 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.677s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:04 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:04 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:04 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:04 devstack sudo[76390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 03 23:42:04 devstack sudo[76390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:05 devstack sudo[76390]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:05 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.734s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:05 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:05 devstack sudo[76395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 23:42:05 devstack sudo[76395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:06 devstack sudo[76395]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:06 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.763s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:06 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:06 devstack sudo[76405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 23:42:06 devstack sudo[76405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:07 devstack sudo[76405]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:07 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.862s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:07 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:07 devstack sudo[76411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 23:42:07 devstack sudo[76411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:08 devstack sudo[76411]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:08 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.972s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:08 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:08 devstack sudo[76418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 23:42:08 devstack sudo[76418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:08 devstack sudo[76418]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:08 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.697s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:08 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:08 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:08 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:08 devstack sudo[76426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 23:42:08 devstack sudo[76426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:09 devstack sudo[76426]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:09 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.748s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:09 devstack cinder-volume[75607]: INFO cinder.volume.drivers.lvm [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 03 23:42:09 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:09 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:09 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:09 devstack sudo[76469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 23:42:09 devstack sudo[76469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:10 devstack sudo[76469]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:10 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.655s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:10 devstack cinder-volume[75607]: DEBUG cinder.volume.drivers.lvm [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Updating volume stats {{(pid=75607) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 23:42:10 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:10 devstack sudo[76552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 23:42:10 devstack sudo[76552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:10 devstack cinder-volume[75433]: DEBUG dbcounter [-] [75433] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:42:11 devstack sudo[76552]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:11 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:11 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:11 devstack sudo[76693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 23:42:11 devstack sudo[76693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:11 devstack sudo[76693]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:11 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:11 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:11 devstack sudo[76696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 23:42:11 devstack sudo[76696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:12 devstack sudo[76696]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:12 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.647s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:12 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:12 devstack sudo[76700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 23:42:12 devstack sudo[76700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:12 devstack sudo[76700]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:12 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:12 devstack cinder-volume[75607]: INFO cinder.volume.driver [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Driver hasn't implemented _init_vendor_properties() Jul 03 23:42:12 devstack cinder-volume[75607]: DEBUG cinder.volume.driver [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75607) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 03 23:42:13 devstack cinder-volume[75607]: DEBUG oslo_db.sqlalchemy.engines [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75607) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 23:42:13 devstack cinder-volume[75607]: DEBUG dbcounter [-] [75607] Writer thread running {{(pid=75607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 23:42:13 devstack cinder-volume[75607]: DEBUG cinder.db.sqlalchemy.api [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Building query based on filter {{(pid=75607) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jul 03 23:42:13 devstack cinder-volume[75607]: DEBUG cinder.image.image_utils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75607) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 03 23:42:13 devstack cinder-volume[75607]: INFO cinder.keymgr.migration [None req-af7f49c0-913e-4a25-90f6-7f6b8274cbbd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 23:42:13 devstack cinder-volume[75607]: DEBUG cinder.volume.drivers.lvm [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Updating volume stats {{(pid=75607) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 23:42:13 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:13 devstack sudo[76704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 23:42:13 devstack sudo[76704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:13 devstack sudo[76704]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:13 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:13 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:13 devstack sudo[76711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 23:42:13 devstack sudo[76711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:14 devstack sudo[76711]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:14 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:14 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:14 devstack sudo[76714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 23:42:14 devstack sudo[76714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:15 devstack sudo[76714]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:15 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:15 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:15 devstack sudo[76717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 23:42:15 devstack sudo[76717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:15 devstack sudo[76717]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:15 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:15 devstack cinder-volume[75607]: DEBUG cinder.manager [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Notifying Schedulers of capabilities ... {{(pid=75607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:42:15 devstack cinder-volume[75607]: INFO cinder.volume.manager [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Driver initialization completed successfully. Jul 03 23:42:15 devstack cinder-volume[75607]: INFO cinder.manager [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Initiating service 2 cleanup Jul 03 23:42:15 devstack cinder-volume[75607]: INFO cinder.manager [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Service 2 cleanup completed. Jul 03 23:42:15 devstack cinder-volume[75607]: DEBUG cinder.service [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Creating RPC server for service cinder-volume {{(pid=75607) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 23:42:15 devstack cinder-volume[75607]: DEBUG cinder.service [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75607) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 23:42:15 devstack cinder-volume[75607]: INFO cinder.volume.manager [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 03 23:42:15 devstack cinder-volume[75607]: DEBUG cinder.volume.drivers.lvm [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Updating volume stats {{(pid=75607) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 23:42:15 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:15 devstack sudo[76721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 23:42:15 devstack sudo[76721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:16 devstack sudo[76721]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:16 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:16 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:16 devstack sudo[76725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 23:42:16 devstack sudo[76725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:17 devstack sudo[76725]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:17 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:17 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:17 devstack sudo[76732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 23:42:17 devstack sudo[76732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:17 devstack sudo[76732]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:17 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.639s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:17 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:42:17 devstack sudo[76789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 23:42:17 devstack sudo[76789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:42:18 devstack sudo[76789]: pam_unix(sudo:session): session closed for user root Jul 03 23:42:18 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.601s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:42:18 devstack cinder-volume[75607]: INFO cinder.volume.manager [None req-d7a397f7-220d-4726-80c9-55a92834f9e6 None None] Driver post RPC initialization completed successfully. Jul 03 23:42:25 devstack cinder-volume[75607]: DEBUG dbcounter [-] [75607] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:42:28 devstack cinder-volume[75607]: DEBUG dbcounter [-] [75607] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:42:47 devstack cinder-volume[75607]: DEBUG oslo_service.periodic_task [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Running periodic task VolumeManager._thread_info {{(pid=75607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:42:47 devstack cinder-volume[75607]: DEBUG cinder.volume.manager [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] thread count: 6 {{(pid=75607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 23:42:47 devstack cinder-volume[75607]: DEBUG cinder.volume.manager [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] thread info: [<_MainThread(MainThread, started 132516472696960)>, , , , , ] {{(pid=75607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 03 23:43:47 devstack cinder-volume[75607]: DEBUG oslo_service.periodic_task [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:43:47 devstack cinder-volume[75607]: DEBUG cinder.volume.drivers.lvm [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Updating volume stats {{(pid=75607) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 23:43:47 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:43:47 devstack sudo[81628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 23:43:47 devstack sudo[81628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:43:48 devstack sudo[81628]: pam_unix(sudo:session): session closed for user root Jul 03 23:43:48 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:43:48 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:43:48 devstack sudo[81671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 23:43:48 devstack sudo[81671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:43:48 devstack sudo[81671]: pam_unix(sudo:session): session closed for user root Jul 03 23:43:48 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:43:48 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:43:48 devstack sudo[81677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 23:43:48 devstack sudo[81677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:43:49 devstack sudo[81677]: pam_unix(sudo:session): session closed for user root Jul 03 23:43:49 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.613s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:43:49 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:43:49 devstack sudo[81680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 23:43:49 devstack sudo[81680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:43:49 devstack sudo[81680]: pam_unix(sudo:session): session closed for user root Jul 03 23:43:49 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:43:49 devstack cinder-volume[75607]: DEBUG cinder.manager [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Notifying Schedulers of capabilities ... {{(pid=75607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:43:50 devstack cinder-volume[75607]: DEBUG oslo_service.periodic_task [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Running periodic task VolumeManager._thread_info {{(pid=75607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:43:50 devstack cinder-volume[75607]: DEBUG cinder.volume.manager [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] thread count: 6 {{(pid=75607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 23:43:50 devstack cinder-volume[75607]: DEBUG cinder.volume.manager [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] thread info: [<_MainThread(MainThread, started 132516472696960)>, , , , , ] {{(pid=75607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 03 23:44:28 devstack cinder-volume[75607]: DEBUG dbcounter [-] [75607] Writing DB stats cinder:SELECT=1 {{(pid=75607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:44:28 devstack cinder-volume[75607]: DEBUG dbcounter [-] [75607] Writing DB stats cinder:UPDATE=1 {{(pid=75607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:44:47 devstack cinder-volume[75607]: DEBUG oslo_service.periodic_task [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:44:47 devstack cinder-volume[75607]: DEBUG cinder.volume.drivers.lvm [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Updating volume stats {{(pid=75607) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 23:44:47 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:44:47 devstack sudo[83138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 23:44:47 devstack sudo[83138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:44:48 devstack sudo[83138]: pam_unix(sudo:session): session closed for user root Jul 03 23:44:48 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:44:48 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:44:48 devstack sudo[83163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 23:44:48 devstack sudo[83163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:44:48 devstack sudo[83163]: pam_unix(sudo:session): session closed for user root Jul 03 23:44:48 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:44:48 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:44:48 devstack sudo[83195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 23:44:48 devstack sudo[83195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:44:49 devstack sudo[83195]: pam_unix(sudo:session): session closed for user root Jul 03 23:44:49 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.715s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:44:49 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:44:49 devstack sudo[83219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 23:44:49 devstack sudo[83219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:44:50 devstack sudo[83219]: pam_unix(sudo:session): session closed for user root Jul 03 23:44:50 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.729s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:44:50 devstack cinder-volume[75607]: DEBUG cinder.manager [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Notifying Schedulers of capabilities ... {{(pid=75607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:44:50 devstack cinder-volume[75607]: DEBUG oslo_service.periodic_task [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Running periodic task VolumeManager._thread_info {{(pid=75607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:44:50 devstack cinder-volume[75607]: DEBUG cinder.volume.manager [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] thread count: 6 {{(pid=75607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 23:44:50 devstack cinder-volume[75607]: DEBUG cinder.volume.manager [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] thread info: [<_MainThread(MainThread, started 132516472696960)>, , , , , ] {{(pid=75607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 03 23:45:47 devstack cinder-volume[75607]: DEBUG oslo_service.periodic_task [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:45:47 devstack cinder-volume[75607]: DEBUG cinder.volume.drivers.lvm [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Updating volume stats {{(pid=75607) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 23:45:47 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:45:47 devstack sudo[84629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 23:45:47 devstack sudo[84629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:45:48 devstack sudo[84629]: pam_unix(sudo:session): session closed for user root Jul 03 23:45:48 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:45:48 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:45:48 devstack sudo[84633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 23:45:48 devstack sudo[84633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:45:48 devstack sudo[84633]: pam_unix(sudo:session): session closed for user root Jul 03 23:45:48 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:45:48 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:45:48 devstack sudo[84652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 23:45:48 devstack sudo[84652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:45:49 devstack sudo[84652]: pam_unix(sudo:session): session closed for user root Jul 03 23:45:49 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.681s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:45:49 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:45:49 devstack sudo[84691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 23:45:49 devstack sudo[84691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:45:50 devstack sudo[84691]: pam_unix(sudo:session): session closed for user root Jul 03 23:45:50 devstack cinder-volume[75607]: DEBUG oslo_concurrency.processutils [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=75607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:45:50 devstack cinder-volume[75607]: DEBUG cinder.manager [None req-eeb1e8c9-f91d-4df9-9569-c1e3e75f969a None None] Notifying Schedulers of capabilities ... {{(pid=75607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:46:28 devstack cinder-volume[75607]: DEBUG dbcounter [-] [75607] Writing DB stats cinder:SELECT=1 {{(pid=75607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:46:28 devstack cinder-volume[75607]: DEBUG dbcounter [-] [75607] Writing DB stats cinder:UPDATE=1 {{(pid=75607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:46:33 devstack cinder-volume[75433]: INFO oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Caught SIGTERM, stopping children Jul 03 23:46:33 devstack cinder-volume[75433]: DEBUG oslo_concurrency.lockutils [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Acquiring lock "singleton_lock" {{(pid=75433) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 23:46:33 devstack cinder-volume[75433]: DEBUG oslo_concurrency.lockutils [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Acquired lock "singleton_lock" {{(pid=75433) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 23:46:33 devstack cinder-volume[75433]: DEBUG oslo_concurrency.lockutils [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Releasing lock "singleton_lock" {{(pid=75433) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 23:46:33 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Stop services. {{(pid=75433) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 03 23:46:33 devstack cinder-volume[75433]: DEBUG oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Killing children. {{(pid=75433) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 03 23:46:33 devstack cinder-volume[75433]: INFO oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Waiting on 1 children to exit Jul 03 23:46:35 devstack cinder-volume[75607]: DEBUG oslo_concurrency.lockutils [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Acquiring lock "singleton_lock" {{(pid=75607) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 23:46:35 devstack cinder-volume[75607]: DEBUG oslo_concurrency.lockutils [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Acquired lock "singleton_lock" {{(pid=75607) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 23:46:35 devstack cinder-volume[75607]: DEBUG oslo_concurrency.lockutils [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Releasing lock "singleton_lock" {{(pid=75607) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 23:46:35 devstack cinder-volume[75607]: WARNING amqp [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 23:46:35 devstack cinder-volume[75607]: WARNING amqp [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 23:46:35 devstack cinder-volume[75433]: INFO oslo_service.backend._eventlet.service [None req-ceb5a67a-6c5b-406a-8ce3-a34d72898728 None None] Child 75607 exited with status 0 Jul 03 23:46:36 devstack cinder-volume[85714]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 23:46:36 devstack cinder-volume[85714]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 23:46:36 devstack cinder-volume[85714]: we strongly recommend against using it for new projects. Jul 03 23:46:36 devstack cinder-volume[85714]: If you are already using Eventlet, we recommend migrating to a different Jul 03 23:46:36 devstack cinder-volume[85714]: framework. For more detail see Jul 03 23:46:36 devstack cinder-volume[85714]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 23:46:36 devstack cinder-volume[85714]: import eventlet # noqa Jul 03 23:46:38 devstack cinder-volume[85714]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85714) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 23:46:38 devstack cinder-volume[85714]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85714) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 23:46:38 devstack cinder-volume[85714]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85714) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 23:46:38 devstack cinder-volume[85714]: INFO dbcounter [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Registered counter for database cinder Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_db.sqlalchemy.engines [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85714) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG dbcounter [-] [85714] Writer thread running {{(pid=85714) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 23:46:39 devstack cinder-volume[85714]: INFO cinder.rpc [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 23:46:39 devstack cinder-volume[85714]: INFO cinder.rpc [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_db.sqlalchemy.engines [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85714) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 23:46:39 devstack cinder-volume[85714]: INFO cinder.volume.manager [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Determined volume DB was empty at startup. Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG cinder.volume.manager [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85714) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 03 23:46:39 devstack cinder-volume[85714]: INFO cinder.volume.manager [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 03 23:46:39 devstack cinder-volume[85714]: WARNING stevedore.named [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 23:46:39 devstack cinder-volume[85714]: WARNING castellan.key_manager [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 23:46:39 devstack cinder-volume[85714]: WARNING cinder.keymgr.conf_key_mgr [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 23:46:39 devstack cinder-volume[85714]: INFO cinder.volume.manager [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_db.sqlalchemy.engines [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85714) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 23:46:39 devstack cinder-volume[85714]: INFO oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Starting 1 workers Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Started child 85930 {{(pid=85714) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Full set of CONF: {{(pid=85714) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] ******************************************************************************** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Configuration options gathered from: {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] ================================================================================ {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] allow_availability_zone_fallback = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] allow_compression_on_image_upload = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] allowed_direct_url_schemes = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] api_rate_limit = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] auth_strategy = keystone {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_availability_zone = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_host = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_stats_polling_interval = 60 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85930]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backup_api_class = cinder.backup.api.API {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backup_name_template = backup-%s {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backup_use_same_host = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backup_use_temp_snapshot = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] chap_password = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] chap_username = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cinder_internal_tenant_project_id = 5249c90969674218bacee2631489c28d {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cinder_internal_tenant_user_id = fcec216b683f4cdeafd93a3159aaed19 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cluster = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] compression_format = gzip {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] compute_api_class = cinder.compute.nova.API {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] config_dir = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] config_source = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] control_exchange = openstack {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] debug = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] default_availability_zone = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] default_group_type = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] default_volume_type = QuobyteHD {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] disk_geometry = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] driver_client_cert = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] driver_client_cert_key = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] driver_data_namespace = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] driver_ssl_cert_path = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] driver_ssl_cert_verify = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] driver_use_ssl = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] enable_new_services = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] enable_unsupported_driver = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] enabled_backends = ['QuobyteHD'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] enforce_multipath_for_image_xfer = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] filter_function = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance_api_insecure = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance_api_servers = ['http://192.168.122.153/image'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance_api_ssl_compression = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance_ca_certificates_file = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance_catalog_info = image:glance:publicURL {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance_certfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance_keyfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance_num_retries = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance_request_timeout = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] goodness_function = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] graceful_shutdown_timeout = 5 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] group_api_class = cinder.group.api.API {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] host = devstack {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] image_compress_on_upload = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] image_conversion_address_space_limit = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] image_conversion_cpu_limit = 60 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] image_conversion_disable = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] image_upload_use_cinder_backend = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] image_upload_use_internal_tenant = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] image_volume_cache_enabled = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] image_volume_cache_max_count = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] image_volume_cache_max_size_gb = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] init_host_max_objects_retrieval = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] instance_format = [instance: %(uuid)s] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] iscsi_target_flags = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] iscsi_write_cache = on {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] iser_helper = tgtadm {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] iser_ip_address = 192.168.122.153 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] iser_port = 3260 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] log_color = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] log_config_append = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] log_dir = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] log_file = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] log_options = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] log_rotate_interval = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] log_rotate_interval_type = days {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] log_rotation_type = none {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] max_age = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] max_logfile_count = 30 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] max_logfile_size_mb = 200 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] max_over_subscription_ratio = 20.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] message_reap_interval = 86400 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] message_ttl = 2592000 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] migration_create_volume_timeout_secs = 300 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] monkey_patch = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] monkey_patch_modules = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] my_ip = 192.168.122.153 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] no_snapshot_gb_quota = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] num_iser_scan_tries = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] num_shell_tries = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] num_volume_device_scan_tries = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] nvmeof_conn_info_version = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] nvmet_ns_id = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] nvmet_port_id = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] osapi_max_limit = 1000 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] osapi_volume_ext_list = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] osapi_volume_listen_port = 8776 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] osapi_volume_use_ssl = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] osapi_volume_workers = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] per_volume_size_limit = -1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] periodic_fuzzy_delay = 60 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] periodic_interval = 60 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] public_endpoint = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] publish_errors = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] quota_backup_gigabytes = 1000 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] quota_backups = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] quota_gigabytes = 1000 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] quota_groups = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] quota_snapshots = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] quota_volumes = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] rate_limit_burst = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] rate_limit_except_level = CRITICAL {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] rate_limit_interval = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] reinit_driver_count = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] replication_device = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] report_discard_supported = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] report_interval = 120 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] reservation_clean_interval = 86400 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] reservation_expire = 86400 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] reserved_image_namespaces = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] reserved_percentage = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] rpc_response_timeout = 120 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] run_external_periodic_tasks = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] scst_target_driver = iscsi {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] scst_target_iqn_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] service_down_time = 720 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] shell_completion = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] snapshot_name_template = snapshot-%s {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] split_loggers = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] state_path = /opt/stack/data/cinder {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] storage_availability_zone = nova {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] storage_protocol = iSCSI {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] syslog_log_facility = LOG_USER {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] target_helper = lioadm {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] target_ip_address = 192.168.122.153 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] target_port = 3260 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] target_protocol = iscsi {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] target_secondary_ip_addresses = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] trace_flags = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] transport_url = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] until_refresh = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] use_chap_auth = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] use_default_quota_class = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] use_journal = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] use_json = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] use_multipath_for_image_xfer = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] use_stderr = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] use_syslog = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] verify_glance_signatures = enabled {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] volume_api_class = cinder.volume.api.API {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] volume_backend_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] volume_clear = zero {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] volume_clear_ionice = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] volume_clear_size = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] volume_copy_bps_limit = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] volume_dd_blocksize = 1M {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] volume_name_template = volume-%s {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] volume_service_inithost_offload = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] volume_usage_audit_period = month {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] zoning_mode = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_concurrency.disable_process_locking = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.auth_section = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.auth_type = password {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.auth_version = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.cache = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.certfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.include_service_catalog = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.insecure = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.interface = public {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.keyfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.memcache_password = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85930]: INFO cinder.volume.manager [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.memcache_username = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.region_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.service_type = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.153/identity {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.backend = dogpile.cache.null {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.backend_argument = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.backend_expiration_time = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.config_prefix = cache.oslo {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.debug_cache_backend = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.enable_retry_client = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.enable_socket_keepalive = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.enabled = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.expiration_time = 600 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.hashclient_retry_attempts = 2 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.memcache_dead_retry = 300 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.memcache_pool_maxsize = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.memcache_sasl_enabled = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.password = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85930]: DEBUG cinder.volume.drivers.remotefs [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85930) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.proxies = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.redis_db = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.redis_server = localhost:6379 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.retry_attempts = 2 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.retry_delay = 0.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.socket_keepalive_count = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.socket_keepalive_idle = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.socket_keepalive_interval = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.socket_timeout = 1.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.tls_allowed_ciphers = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.tls_cafile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.tls_certfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.tls_enabled = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.tls_keyfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cache.username = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.asyncio_connection = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.asyncio_slave_connection = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.backend = sqlalchemy {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.connection = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.connection_debug = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.connection_parameters = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.connection_recycle_time = 3600 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.connection_trace = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.db_inc_retry_interval = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.db_max_retries = 20 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.db_max_retry_interval = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.db_retry_interval = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.max_overflow = 50 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.max_pool_size = 5 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.max_retries = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.mysql_wsrep_sync_wait = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.pool_timeout = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.retry_interval = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.slave_connection = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.sqlite_synchronous = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.synchronous_reader = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] database.use_db_reconnect = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] profiler.connection_string = messaging:// {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] profiler.enabled = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] profiler.es_doc_type = notification {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] profiler.es_scroll_size = 10000 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] profiler.es_scroll_time = 2m {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] profiler.filter_error_trace = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] profiler.hmac_keys = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] profiler.sentinel_service_name = mymaster {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] profiler.socket_timeout = 0.1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] profiler.trace_requests = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] profiler.trace_sqlalchemy = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] profiler_jaeger.process_tags = {} {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] profiler_jaeger.service_name_prefix = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] profiler_otlp.service_name_prefix = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_policy.enforce_new_defaults = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_policy.enforce_scope = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_policy.policy_default_rule = default {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_policy.policy_file = policy.yaml {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] coordination.backend_url = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] privsep_osbrick.group = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] privsep_osbrick.helper_command = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] privsep_osbrick.user = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cinder_sys_admin.group = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cinder_sys_admin.helper_command = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] cinder_sys_admin.user = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] service_user.auth_section = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] service_user.auth_type = password {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] service_user.cafile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] service_user.certfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] service_user.collect_timing = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] service_user.insecure = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] service_user.keyfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] service_user.send_service_user_token = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] service_user.split_loggers = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] service_user.timeout = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance.auth_section = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance.auth_type = password {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance.certfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance.collect_timing = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance.insecure = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance.keyfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance.region_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance.split_loggers = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] glance.timeout = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.backend_availability_zone = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.chap_password = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.chap_username = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.disk_geometry = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.driver_client_cert = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.driver_client_cert_key = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.driver_data_namespace = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.driver_use_ssl = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.extra_capabilities = {} {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.filter_function = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.goodness_function = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.iscsi_target_flags = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.iscsi_write_cache = on {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.iser_helper = tgtadm {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.iser_ip_address = 192.168.122.153 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.iser_port = 3260 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.nas_host = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.nas_login = admin {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.nas_mount_options = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.nas_password = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.nas_private_key = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.nas_share_path = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.num_shell_tries = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.quobyte_volume_url = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.replication_device = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.report_discard_supported = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.reserved_percentage = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.target_helper = tgtadm {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.target_ip_address = 192.168.122.153 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.target_port = 3260 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.target_protocol = iscsi {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.trace_flags = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.unique_fqdn_network = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.use_chap_auth = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.volume_backend_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.volume_clear = zero {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.volume_clear_ionice = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.volume_clear_size = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_reports.file_event_handler = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_reports.log_dir = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.backend_availability_zone = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.backend_host = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.chap_password = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.chap_username = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.chiscsi_conf = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.disk_geometry = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.driver_client_cert = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.driver_data_namespace = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.driver_use_ssl = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.extra_capabilities = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.filter_function = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.goodness_function = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.iser_helper = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.iser_ip_address = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.iser_port = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.iser_target_prefix = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.nas_host = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.nas_login = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.nas_mount_options = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.nas_password = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.nas_private_key = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.nas_share_path = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.nas_ssh_port = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.num_shell_tries = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.nvmet_port_id = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.replication_device = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85930]: DEBUG cinder.volume.drivers.quobyte [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85930) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 03 23:46:39 devstack cinder-volume[85930]: WARNING cinder.volume.drivers.quobyte [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 03 23:46:39 devstack cinder-volume[85930]: WARNING cinder.volume.drivers.quobyte [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.report_discard_supported = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.reserved_percentage = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.scst_target_driver = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.storage_protocol = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85930]: DEBUG oslo_concurrency.processutils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Running cmd (subprocess): mount.quobyte {{(pid=85930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.target_helper = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.target_ip_address = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.target_port = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.target_prefix = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.target_protocol = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.trace_flags = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.use_chap_auth = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.volume_clear = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.volume_clear_size = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] QuobyteHD.volumes_dir = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:39 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.ssl = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_notifications.driver = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_notifications.retry = -1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] key_manager.fixed_key = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican.barbican_api_version = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican.barbican_endpoint = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican.barbican_endpoint_type = public {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican.barbican_region_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican.cafile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican.certfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican.collect_timing = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican.insecure = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican.keyfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican.number_of_retries = 60 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican.retry_delay = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican.send_service_user_token = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican.split_loggers = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican.timeout = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican.verify_ssl = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican.verify_ssl_path = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican_service_user.auth_section = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican_service_user.auth_type = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican_service_user.cafile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican_service_user.certfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican_service_user.collect_timing = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican_service_user.insecure = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican_service_user.keyfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican_service_user.split_loggers = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] barbican_service_user.timeout = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] vault.approle_role_id = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] vault.approle_secret_id = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] vault.kv_mountpoint = secret {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] vault.kv_path = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] vault.kv_version = 2 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] vault.namespace = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] vault.root_token_id = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] vault.ssl_ca_crt_file = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] vault.timeout = 60.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] vault.use_ssl = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:40 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] ******************************************************************************** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 23:46:40 devstack quobyte-client[85931]: Reading configuration file: /etc/quobyte/client.cfg Jul 03 23:46:40 devstack quobyte-client[85931]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 03 23:46:40 devstack cinder-volume[85930]: DEBUG oslo_concurrency.processutils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] CMD "mount.quobyte" returned: 1 in 0.151s {{(pid=85930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:46:40 devstack cinder-volume[85930]: DEBUG oslo_concurrency.lockutils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85930) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:46:40 devstack cinder-volume[85930]: DEBUG oslo_concurrency.lockutils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85930) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:46:40 devstack cinder-volume[85930]: DEBUG cinder.volume.drivers.quobyte [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=85930) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:46:40 devstack cinder-volume[85930]: INFO cinder.volume.drivers.quobyte [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 ... Jul 03 23:46:40 devstack cinder-volume[85930]: DEBUG oslo_concurrency.processutils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d -c /etc/quobyte/client-cinder.cfg {{(pid=85930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:46:40 devstack sudo[85936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d -c /etc/quobyte/client-cinder.cfg Jul 03 23:46:40 devstack sudo[85936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:46:40 devstack sudo[85936]: pam_unix(sudo:session): session closed for user root Jul 03 23:46:40 devstack cinder-volume[85930]: DEBUG oslo_concurrency.processutils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.759s {{(pid=85930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:46:40 devstack cinder-volume[85930]: INFO cinder.volume.drivers.quobyte [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 succeeded Jul 03 23:46:40 devstack cinder-volume[85930]: DEBUG cinder.volume.drivers.quobyte [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=85930) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:46:40 devstack cinder-volume[85930]: DEBUG oslo_concurrency.lockutils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.768s {{(pid=85930) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:46:40 devstack cinder-volume[85930]: DEBUG oslo_concurrency.processutils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=85930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:46:40 devstack sudo[86007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:46:40 devstack sudo[86007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:46:41 devstack sudo[86007]: pam_unix(sudo:session): session closed for user root Jul 03 23:46:41 devstack cinder-volume[85930]: DEBUG oslo_concurrency.processutils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.611s {{(pid=85930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:46:41 devstack cinder-volume[85930]: INFO cinder.volume.driver [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Driver hasn't implemented _init_vendor_properties() Jul 03 23:46:41 devstack cinder-volume[85930]: DEBUG cinder.volume.driver [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85930) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 03 23:46:41 devstack cinder-volume[85930]: DEBUG oslo_db.sqlalchemy.engines [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85930) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 23:46:41 devstack cinder-volume[85930]: DEBUG dbcounter [-] [85930] Writer thread running {{(pid=85930) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 23:46:41 devstack cinder-volume[85930]: DEBUG cinder.db.sqlalchemy.api [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Building query based on filter {{(pid=85930) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jul 03 23:46:41 devstack cinder-volume[85930]: DEBUG cinder.image.image_utils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85930) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 03 23:46:41 devstack cinder-volume[85930]: INFO cinder.keymgr.migration [None req-62c8ea55-23cb-421a-8edf-bc91a25e07a9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 23:46:41 devstack cinder-volume[85930]: DEBUG oslo_concurrency.lockutils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85930) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:46:41 devstack cinder-volume[85930]: DEBUG oslo_concurrency.lockutils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85930) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:46:41 devstack cinder-volume[85930]: DEBUG cinder.volume.drivers.quobyte [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=85930) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:46:41 devstack cinder-volume[85930]: DEBUG cinder.volume.drivers.quobyte [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=85930) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:46:41 devstack cinder-volume[85930]: DEBUG oslo_concurrency.lockutils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85930) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:46:41 devstack cinder-volume[85930]: DEBUG oslo_concurrency.processutils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=85930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:46:41 devstack sudo[86010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:46:41 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:46:42 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root Jul 03 23:46:42 devstack cinder-volume[85930]: DEBUG oslo_concurrency.processutils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.671s {{(pid=85930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:46:42 devstack cinder-volume[85930]: DEBUG cinder.manager [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Notifying Schedulers of capabilities ... {{(pid=85930) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:46:42 devstack cinder-volume[85930]: INFO cinder.volume.manager [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Driver initialization completed successfully. Jul 03 23:46:42 devstack cinder-volume[85930]: INFO cinder.manager [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Initiating service 3 cleanup Jul 03 23:46:42 devstack cinder-volume[85930]: INFO cinder.manager [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Service 3 cleanup completed. Jul 03 23:46:42 devstack cinder-volume[85930]: DEBUG cinder.service [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Creating RPC server for service cinder-volume {{(pid=85930) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 23:46:42 devstack cinder-volume[85930]: DEBUG cinder.service [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85930) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 23:46:42 devstack cinder-volume[85930]: INFO cinder.volume.manager [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 03 23:46:42 devstack cinder-volume[85930]: DEBUG oslo_concurrency.lockutils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85930) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:46:42 devstack cinder-volume[85930]: DEBUG oslo_concurrency.lockutils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85930) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:46:42 devstack cinder-volume[85930]: DEBUG cinder.volume.drivers.quobyte [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=85930) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:46:42 devstack cinder-volume[85930]: DEBUG cinder.volume.drivers.quobyte [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=85930) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:46:42 devstack cinder-volume[85930]: DEBUG oslo_concurrency.lockutils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85930) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:46:42 devstack cinder-volume[85930]: DEBUG oslo_concurrency.processutils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=85930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:46:42 devstack sudo[86017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:46:42 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:46:43 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root Jul 03 23:46:43 devstack cinder-volume[85930]: DEBUG oslo_concurrency.processutils [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.730s {{(pid=85930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:46:43 devstack cinder-volume[85930]: INFO cinder.volume.manager [None req-304b8bac-404e-498b-9c0b-23f8ed0be113 None None] Driver post RPC initialization completed successfully. Jul 03 23:46:47 devstack cinder-volume[85930]: DEBUG oslo_concurrency.lockutils [None req-aaeaaf03-a021-4b26-9ff4-8e77a467b190 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85930) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:46:47 devstack cinder-volume[85930]: DEBUG oslo_concurrency.lockutils [None req-aaeaaf03-a021-4b26-9ff4-8e77a467b190 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85930) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:46:47 devstack cinder-volume[85930]: DEBUG cinder.volume.drivers.quobyte [None req-aaeaaf03-a021-4b26-9ff4-8e77a467b190 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=85930) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:46:47 devstack cinder-volume[85930]: DEBUG cinder.volume.drivers.quobyte [None req-aaeaaf03-a021-4b26-9ff4-8e77a467b190 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=85930) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:46:47 devstack cinder-volume[85930]: DEBUG oslo_concurrency.lockutils [None req-aaeaaf03-a021-4b26-9ff4-8e77a467b190 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85930) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:46:47 devstack cinder-volume[85930]: DEBUG oslo_concurrency.processutils [None req-aaeaaf03-a021-4b26-9ff4-8e77a467b190 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=85930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:46:47 devstack sudo[86161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:46:47 devstack sudo[86161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:46:47 devstack sudo[86161]: pam_unix(sudo:session): session closed for user root Jul 03 23:46:47 devstack cinder-volume[85930]: DEBUG oslo_concurrency.processutils [None req-aaeaaf03-a021-4b26-9ff4-8e77a467b190 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.597s {{(pid=85930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:46:47 devstack cinder-volume[85930]: DEBUG cinder.manager [None req-aaeaaf03-a021-4b26-9ff4-8e77a467b190 None None] Notifying Schedulers of capabilities ... {{(pid=85930) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:46:49 devstack cinder-volume[85714]: INFO oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Caught SIGTERM, stopping children Jul 03 23:46:49 devstack cinder-volume[85714]: DEBUG oslo_concurrency.lockutils [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Acquiring lock "singleton_lock" {{(pid=85714) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 23:46:49 devstack cinder-volume[85714]: DEBUG oslo_concurrency.lockutils [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Acquired lock "singleton_lock" {{(pid=85714) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 23:46:49 devstack cinder-volume[85714]: DEBUG oslo_concurrency.lockutils [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Releasing lock "singleton_lock" {{(pid=85714) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 23:46:49 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Stop services. {{(pid=85714) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 03 23:46:49 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Killing children. {{(pid=85714) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 03 23:46:49 devstack cinder-volume[85714]: INFO oslo_service.backend._eventlet.service [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Waiting on 1 children to exit Jul 03 23:46:53 devstack cinder-volume[85930]: DEBUG dbcounter [-] [85930] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85930) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:46:53 devstack cinder-volume[85930]: DEBUG dbcounter [-] [85930] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=85930) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:46:54 devstack cinder-volume[85930]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 03 23:46:55 devstack cinder-volume[86379]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 23:46:55 devstack cinder-volume[86379]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 23:46:55 devstack cinder-volume[86379]: we strongly recommend against using it for new projects. Jul 03 23:46:55 devstack cinder-volume[86379]: If you are already using Eventlet, we recommend migrating to a different Jul 03 23:46:55 devstack cinder-volume[86379]: framework. For more detail see Jul 03 23:46:55 devstack cinder-volume[86379]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 23:46:55 devstack cinder-volume[86379]: import eventlet # noqa Jul 03 23:46:55 devstack cinder-volume[85930]: DEBUG oslo_concurrency.lockutils [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Acquiring lock "singleton_lock" {{(pid=85930) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 23:46:55 devstack cinder-volume[85930]: DEBUG oslo_concurrency.lockutils [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Acquired lock "singleton_lock" {{(pid=85930) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 23:46:55 devstack cinder-volume[85930]: DEBUG oslo_concurrency.lockutils [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Releasing lock "singleton_lock" {{(pid=85930) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 23:46:55 devstack cinder-volume[85930]: WARNING amqp [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 23:46:55 devstack cinder-volume[85930]: WARNING amqp [None req-a6bab43d-cea5-4c27-b34d-651802d117b2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 23:46:57 devstack cinder-volume[86379]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 23:46:57 devstack cinder-volume[86379]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 23:46:57 devstack cinder-volume[86379]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 23:46:58 devstack cinder-volume[86379]: INFO dbcounter [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] Registered counter for database cinder Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_db.sqlalchemy.engines [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86379) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG dbcounter [-] [86379] Writer thread running {{(pid=86379) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 23:46:58 devstack cinder-volume[86379]: INFO cinder.rpc [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 23:46:58 devstack cinder-volume[86379]: INFO cinder.rpc [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_db.sqlalchemy.engines [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86379) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 23:46:58 devstack cinder-volume[86379]: INFO cinder.volume.manager [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] Determined volume DB was empty at startup. Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG cinder.volume.manager [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86379) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 03 23:46:58 devstack cinder-volume[86379]: WARNING stevedore.named [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 23:46:58 devstack cinder-volume[86379]: WARNING castellan.key_manager [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 23:46:58 devstack cinder-volume[86379]: WARNING cinder.keymgr.conf_key_mgr [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 23:46:58 devstack cinder-volume[86379]: INFO cinder.volume.manager [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_db.sqlalchemy.engines [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86379) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 23:46:58 devstack cinder-volume[86379]: INFO oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] Starting 1 workers Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] Started child 86676 {{(pid=86379) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] Full set of CONF: {{(pid=86379) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] ******************************************************************************** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] Configuration options gathered from: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] ================================================================================ {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] allow_availability_zone_fallback = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] allow_compression_on_image_upload = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] allowed_direct_url_schemes = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] api_rate_limit = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] auth_strategy = keystone {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86676]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_availability_zone = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_host = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_stats_polling_interval = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backup_api_class = cinder.backup.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backup_name_template = backup-%s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backup_use_same_host = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backup_use_temp_snapshot = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] chap_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] chap_username = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cinder_internal_tenant_project_id = 5249c90969674218bacee2631489c28d {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cinder_internal_tenant_user_id = fcec216b683f4cdeafd93a3159aaed19 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cluster = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] compression_format = gzip {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] compute_api_class = cinder.compute.nova.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] config_dir = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] config_source = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] control_exchange = openstack {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] debug = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] default_availability_zone = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] default_group_type = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] default_volume_type = QuobyteHD {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] disk_geometry = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] driver_client_cert = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] driver_client_cert_key = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] driver_data_namespace = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] driver_ssl_cert_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] driver_ssl_cert_verify = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] driver_use_ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] enable_new_services = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] enable_unsupported_driver = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] enabled_backends = ['QuobyteHD'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] enforce_multipath_for_image_xfer = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] filter_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance_api_insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance_api_servers = ['http://192.168.122.153/image'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance_api_ssl_compression = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance_ca_certificates_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance_catalog_info = image:glance:publicURL {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance_certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance_keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance_num_retries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance_request_timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] goodness_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] graceful_shutdown_timeout = 5 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] group_api_class = cinder.group.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] host = devstack {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] image_compress_on_upload = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] image_conversion_address_space_limit = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] image_conversion_cpu_limit = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] image_conversion_disable = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] image_upload_use_cinder_backend = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] image_upload_use_internal_tenant = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] image_volume_cache_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] image_volume_cache_max_count = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] image_volume_cache_max_size_gb = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 03 23:46:58 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] init_host_max_objects_retrieval = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86676) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] instance_format = [instance: %(uuid)s] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] iscsi_target_flags = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] iscsi_write_cache = on {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] iser_helper = tgtadm {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] iser_ip_address = 192.168.122.153 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] iser_port = 3260 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] log_color = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] log_config_append = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] log_dir = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] log_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] log_options = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] log_rotate_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] log_rotate_interval_type = days {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] log_rotation_type = none {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack quobyte-client[86677]: Reading configuration file: /etc/quobyte/client.cfg Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] max_age = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] max_logfile_count = 30 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] max_logfile_size_mb = 200 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack quobyte-client[86677]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] max_over_subscription_ratio = 20.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] message_reap_interval = 86400 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] message_ttl = 2592000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] migration_create_volume_timeout_secs = 300 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] monkey_patch = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] monkey_patch_modules = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] my_ip = 192.168.122.153 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] no_snapshot_gb_quota = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] num_iser_scan_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] num_shell_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] num_volume_device_scan_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] nvmeof_conn_info_version = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] nvmet_ns_id = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] nvmet_port_id = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] osapi_max_limit = 1000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] osapi_volume_ext_list = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] osapi_volume_listen = 0.0.0.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] osapi_volume_listen_port = 8776 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] osapi_volume_use_ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] osapi_volume_workers = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] per_volume_size_limit = -1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] periodic_fuzzy_delay = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] periodic_interval = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] project_id_regex = [0-9a-f\-]+ {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] public_endpoint = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] publish_errors = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] quota_backup_gigabytes = 1000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] quota_backups = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] quota_gigabytes = 1000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] quota_groups = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] quota_snapshots = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] quota_volumes = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] rate_limit_burst = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] rate_limit_except_level = CRITICAL {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] rate_limit_interval = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] reinit_driver_count = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] replication_device = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] report_discard_supported = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] report_interval = 120 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] reservation_clean_interval = 86400 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] reservation_expire = 86400 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] reserved_image_namespaces = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] reserved_percentage = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] rpc_response_timeout = 120 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] run_external_periodic_tasks = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] scst_target_driver = iscsi {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] scst_target_iqn_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] service_down_time = 720 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] shell_completion = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] snapshot_name_template = snapshot-%s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] state_path = /opt/stack/data/cinder {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] storage_availability_zone = nova {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] storage_protocol = iSCSI {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] syslog_log_facility = LOG_USER {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] target_helper = lioadm {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] target_ip_address = 192.168.122.153 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] target_port = 3260 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] target_protocol = iscsi {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] target_secondary_ip_addresses = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] trace_flags = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] transfer_api_class = cinder.transfer.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] transport_url = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] until_refresh = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] use_chap_auth = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] use_default_quota_class = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] use_journal = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] use_json = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] use_multipath_for_image_xfer = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] use_stderr = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] use_syslog = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] verify_glance_signatures = enabled {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] volume_api_class = cinder.volume.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] volume_backend_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] volume_clear = zero {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] volume_clear_ionice = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] volume_clear_size = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] volume_copy_bps_limit = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] volume_dd_blocksize = 1M {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] volume_name_template = volume-%s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] volume_service_inithost_offload = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] volume_usage_audit_period = month {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] zoning_mode = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_concurrency.disable_process_locking = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86676) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.quobyte [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.auth_section = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.auth_type = password {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.auth_version = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.cache = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.quobyte [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.delay_auth_decision = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.http_connect_timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.include_service_catalog = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.interface = public {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Running cmd (subprocess): mount.quobyte {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.memcache_password = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.memcache_username = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.region_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.service_token_roles_required = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.service_type = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.token_cache_time = 300 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.153/identity {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.backend = dogpile.cache.null {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.backend_argument = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.backend_expiration_time = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.config_prefix = cache.oslo {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.debug_cache_backend = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.enable_retry_client = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.enable_socket_keepalive = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.expiration_time = 600 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.hashclient_retry_attempts = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.memcache_dead_retry = 300 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.memcache_pool_maxsize = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.memcache_sasl_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.proxies = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.redis_db = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.redis_sentinel_service_name = mymaster {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.redis_server = localhost:6379 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.retry_attempts = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.retry_delay = 0.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.socket_keepalive_count = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.socket_keepalive_idle = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.socket_keepalive_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.socket_timeout = 1.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.tls_allowed_ciphers = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.tls_cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.tls_certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.tls_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.tls_keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cache.username = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.asyncio_connection = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.asyncio_slave_connection = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.backend = sqlalchemy {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.connection = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.connection_debug = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.connection_parameters = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.connection_recycle_time = 3600 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.connection_trace = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.db_inc_retry_interval = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.db_max_retries = 20 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.db_max_retry_interval = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.db_retry_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.max_overflow = 50 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.max_pool_size = 5 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.max_retries = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.mysql_wsrep_sync_wait = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.pool_timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.retry_interval = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.slave_connection = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.sqlite_synchronous = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.synchronous_reader = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] database.use_db_reconnect = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] profiler.connection_string = messaging:// {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] profiler.enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] profiler.es_doc_type = notification {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] profiler.es_scroll_size = 10000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] profiler.es_scroll_time = 2m {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] profiler.filter_error_trace = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] profiler.hmac_keys = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] profiler.sentinel_service_name = mymaster {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] profiler.socket_timeout = 0.1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] profiler.trace_requests = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] profiler.trace_sqlalchemy = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] profiler_jaeger.process_tags = {} {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] profiler_jaeger.service_name_prefix = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] profiler_otlp.service_name_prefix = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_policy.enforce_new_defaults = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_policy.enforce_scope = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_policy.policy_default_rule = default {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_policy.policy_file = policy.yaml {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_policy.remote_timeout = 60.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] coordination.backend_url = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] privsep_osbrick.group = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] privsep_osbrick.helper_command = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] privsep_osbrick.user = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cinder_sys_admin.group = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cinder_sys_admin.helper_command = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] cinder_sys_admin.user = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] service_user.auth_section = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] service_user.auth_type = password {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] service_user.cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] service_user.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] service_user.collect_timing = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] service_user.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] service_user.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] service_user.send_service_user_token = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] service_user.split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] service_user.timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance.auth_section = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance.auth_type = password {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance.collect_timing = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance.region_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance.split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] glance.timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.backend_availability_zone = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.chap_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.chap_username = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.disk_geometry = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.driver_client_cert = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.driver_client_cert_key = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.driver_data_namespace = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.driver_use_ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.enable_unsupported_driver = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.extra_capabilities = {} {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.filter_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.goodness_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.iscsi_target_flags = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.iscsi_write_cache = on {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.iser_helper = tgtadm {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.iser_ip_address = 192.168.122.153 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.iser_port = 3260 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.nas_host = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.nas_login = admin {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.nas_mount_options = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.nas_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.nas_private_key = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.nas_share_path = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.nas_ssh_port = 22 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.num_shell_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.nvmet_port_id = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.quobyte_client_cfg = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.quobyte_volume_url = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.replication_device = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.report_discard_supported = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.reserved_percentage = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.scst_target_driver = iscsi {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.scst_target_iqn_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.storage_protocol = iSCSI {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.target_helper = tgtadm {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.target_ip_address = 192.168.122.153 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.target_port = 3260 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.target_protocol = iscsi {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.trace_flags = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.unique_fqdn_network = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.use_chap_auth = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.volume_backend_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.volume_clear = zero {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.volume_clear_ionice = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.volume_clear_size = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_reports.file_event_handler = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_reports.log_dir = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.backend_availability_zone = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.backend_host = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.chap_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.chap_username = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.chiscsi_conf = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.disk_geometry = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.driver_client_cert = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.driver_client_cert_key = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.driver_data_namespace = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.driver_use_ssl = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.extra_capabilities = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.filter_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.goodness_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.iscsi_target_flags = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.iscsi_write_cache = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.iser_helper = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.iser_ip_address = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.iser_port = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.iser_target_prefix = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.nas_host = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.nas_login = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.nas_mount_options = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.nas_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.nas_private_key = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.nas_share_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.nas_ssh_port = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.num_shell_tries = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.nvmet_ns_id = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.nvmet_port_id = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.replication_device = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.report_discard_supported = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.reserved_percentage = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.scst_target_driver = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.storage_protocol = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.target_helper = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.target_ip_address = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.target_port = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.target_prefix = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.target_protocol = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.trace_flags = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.unique_fqdn_network = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.use_chap_auth = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.volume_clear = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.volume_clear_ionice = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.volume_clear_size = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] QuobyteHD.volumes_dir = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.ssl_version = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_notifications.driver = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_notifications.retry = -1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] oslo_messaging_notifications.transport_url = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] key_manager.fixed_key = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican.barbican_api_version = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican.barbican_endpoint = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican.barbican_endpoint_type = public {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican.barbican_region_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican.cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican.collect_timing = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican.number_of_retries = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican.retry_delay = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican.send_service_user_token = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican.split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican.timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican.verify_ssl = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican.verify_ssl_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican_service_user.auth_section = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican_service_user.auth_type = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican_service_user.cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican_service_user.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican_service_user.collect_timing = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican_service_user.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican_service_user.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican_service_user.split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] barbican_service_user.timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] vault.approle_role_id = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] vault.approle_secret_id = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] vault.kv_mountpoint = secret {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] vault.kv_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] vault.kv_version = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] vault.namespace = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] vault.root_token_id = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] vault.ssl_ca_crt_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] vault.timeout = 60.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] vault.use_ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 23:46:59 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-6c1d1abc-683f-49b3-bf00-fb490df3ae1e None None] ******************************************************************************** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 23:46:59 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.665s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:46:59 devstack cinder-volume[86676]: INFO cinder.volume.driver [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Driver hasn't implemented _init_vendor_properties() Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG cinder.volume.driver [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86676) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG oslo_db.sqlalchemy.engines [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writer thread running {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG cinder.db.sqlalchemy.api [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Building query based on filter {{(pid=86676) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86676) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:46:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:46:59 devstack cinder-volume[86676]: INFO cinder.keymgr.migration [None req-dbb609a0-67d9-44f5-9922-d8bfb6a22f6c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 23:46:59 devstack sudo[86686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:46:59 devstack sudo[86686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:47:00 devstack sudo[86686]: pam_unix(sudo:session): session closed for user root Jul 03 23:47:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.616s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:47:00 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:47:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Driver initialization completed successfully. Jul 03 23:47:00 devstack cinder-volume[86676]: INFO cinder.manager [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Initiating service 3 cleanup Jul 03 23:47:00 devstack cinder-volume[86676]: INFO cinder.manager [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Service 3 cleanup completed. Jul 03 23:47:00 devstack cinder-volume[86676]: DEBUG cinder.service [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Creating RPC server for service cinder-volume {{(pid=86676) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 23:47:00 devstack cinder-volume[86676]: DEBUG cinder.service [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86676) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 23:47:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 03 23:47:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:47:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:47:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:47:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:47:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:47:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:47:00 devstack sudo[86692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:47:00 devstack sudo[86692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:47:01 devstack sudo[86692]: pam_unix(sudo:session): session closed for user root Jul 03 23:47:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.602s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:47:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a5294d42-719b-4cfe-8a3f-256aefc43307 None None] Driver post RPC initialization completed successfully. Jul 03 23:47:08 devstack cinder-volume[86379]: DEBUG dbcounter [-] [86379] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86379) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:47:10 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:47:11 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:47:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:47:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 6 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 23:47:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 03 23:47:56 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Flow 'volume_create_manager' (0f547706-ac7f-47ab-9414-aded6461fa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a57672-d562-4ad8-a102-fceba2639865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a57672-d562-4ad8-a102-fceba2639865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1925526666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433cf579-617d-45e4-9eeb-006b39ee7deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4e228240b94a0d941a5800e50b774e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:47:57Z,use_quota=True,user_id='bb8b7714db8e41e7b5e50fefa774ede6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16db7d7-7255-4e86-8ef5-d8c5761058e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16db7d7-7255-4e86-8ef5-d8c5761058e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce5eb97-8956-4710-a451-ac96d9c3166d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce5eb97-8956-4710-a451-ac96d9c3166d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '433cf579-617d-45e4-9eeb-006b39ee7deb', 'volume_name': 'volume-433cf579-617d-45e4-9eeb-006b39ee7deb', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fee12f4-8382-477b-a98a-61b1a0a4fe9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fee12f4-8382-477b-a98a-61b1a0a4fe9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd9a4b4-9c42-4c54-9331-a6355a589e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:47:57 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Volume 433cf579-617d-45e4-9eeb-006b39ee7deb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-433cf579-617d-45e4-9eeb-006b39ee7deb', 'volume_size': 1} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1925526666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433cf579-617d-45e4-9eeb-006b39ee7deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4e228240b94a0d941a5800e50b774e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:47:57Z,use_quota=True,user_id='bb8b7714db8e41e7b5e50fefa774ede6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Creating volume 433cf579-617d-45e4-9eeb-006b39ee7deb {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:47:57 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:47:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-433cf579-617d-45e4-9eeb-006b39ee7deb 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:47:57 devstack sudo[86810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-433cf579-617d-45e4-9eeb-006b39ee7deb 1073741824 Jul 03 23:47:57 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:47:58 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root Jul 03 23:47:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-433cf579-617d-45e4-9eeb-006b39ee7deb 1073741824" returned: 0 in 1.050s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:47:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-433cf579-617d-45e4-9eeb-006b39ee7deb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:47:58 devstack sudo[87129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-433cf579-617d-45e4-9eeb-006b39ee7deb Jul 03 23:47:58 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:47:58 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root Jul 03 23:47:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-433cf579-617d-45e4-9eeb-006b39ee7deb" returned: 0 in 0.745s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:47:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:47:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:47:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd9a4b4-9c42-4c54-9331-a6355a589e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-433cf579-617d-45e4-9eeb-006b39ee7deb', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:47:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3aa5f2-befc-44a7-ba1b-8f3e6087d48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:47:59 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Volume volume-433cf579-617d-45e4-9eeb-006b39ee7deb (433cf579-617d-45e4-9eeb-006b39ee7deb): created successfully Jul 03 23:47:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3aa5f2-befc-44a7-ba1b-8f3e6087d48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:47:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Flow 'volume_create_manager' (0f547706-ac7f-47ab-9414-aded6461fa0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:47:59 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fc0f5188-9f4c-4c4a-88d5-3416c9cd3ba8 tempest-TaggedAttachmentsTest-1499948303 None] Created volume successfully. Jul 03 23:48:09 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:48:09 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:48:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:48:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:48:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:48:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:48:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:48:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:48:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:48:33 devstack sudo[87539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:48:33 devstack sudo[87539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:48:34 devstack sudo[87539]: pam_unix(sudo:session): session closed for user root Jul 03 23:48:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.217s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:48:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:48:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 6 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 23:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Flow 'volume_create_manager' (c85a67d7-3dfd-469c-ae77-42a3f1752391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ad69ae-5034-406f-9b02-8b41bfa20ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ad69ae-5034-406f-9b02-8b41bfa20ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-535824464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e336a4-77da-42e1-888c-d9abeb924fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae8030949fe44d39355550deecfc18a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:48:35Z,use_quota=True,user_id='655ae8591d3e435db5dc059c253fd243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57989b8d-f88f-4cee-9e3c-ed5d172879cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57989b8d-f88f-4cee-9e3c-ed5d172879cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6d74fa-65b8-4e0f-b16a-f5e462425730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6d74fa-65b8-4e0f-b16a-f5e462425730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e336a4-77da-42e1-888c-d9abeb924fd5', 'volume_name': 'volume-a8e336a4-77da-42e1-888c-d9abeb924fd5', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27ce36c-85f2-4648-9af0-66fbb5989296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27ce36c-85f2-4648-9af0-66fbb5989296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037b2cfa-7a9d-4f09-9fb1-0ac57fceed4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:48:35 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Volume a8e336a4-77da-42e1-888c-d9abeb924fd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e336a4-77da-42e1-888c-d9abeb924fd5', 'volume_size': 1} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-535824464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e336a4-77da-42e1-888c-d9abeb924fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae8030949fe44d39355550deecfc18a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:48:35Z,use_quota=True,user_id='655ae8591d3e435db5dc059c253fd243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Creating volume a8e336a4-77da-42e1-888c-d9abeb924fd5 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:48:35 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:48:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a8e336a4-77da-42e1-888c-d9abeb924fd5 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:48:35 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a8e336a4-77da-42e1-888c-d9abeb924fd5 1073741824 Jul 03 23:48:35 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:48:37 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Jul 03 23:48:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a8e336a4-77da-42e1-888c-d9abeb924fd5 1073741824" returned: 0 in 2.267s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:48:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a8e336a4-77da-42e1-888c-d9abeb924fd5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:48:37 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a8e336a4-77da-42e1-888c-d9abeb924fd5 Jul 03 23:48:37 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:48:40 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Jul 03 23:48:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a8e336a4-77da-42e1-888c-d9abeb924fd5" returned: 0 in 2.510s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:48:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] <== create_volume: return (4943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:48:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.954s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:48:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037b2cfa-7a9d-4f09-9fb1-0ac57fceed4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e336a4-77da-42e1-888c-d9abeb924fd5', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:48:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a3f13c-238d-4b3b-bd2c-0dbdf699a892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:48:40 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Volume volume-a8e336a4-77da-42e1-888c-d9abeb924fd5 (a8e336a4-77da-42e1-888c-d9abeb924fd5): created successfully Jul 03 23:48:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a3f13c-238d-4b3b-bd2c-0dbdf699a892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:48:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Flow 'volume_create_manager' (c85a67d7-3dfd-469c-ae77-42a3f1752391) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:48:40 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3b375c40-3804-4fc6-b869-64aa50764c16 tempest-VolumesAdminNegativeTest-1302048276 None] Created volume successfully. Jul 03 23:48:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Acquiring lock "cinder-a8e336a4-77da-42e1-888c-d9abeb924fd5-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:48:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Lock "cinder-a8e336a4-77da-42e1-888c-d9abeb924fd5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:48:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Acquiring lock "cinder-quobyte-a8e336a4-77da-42e1-888c-d9abeb924fd5" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:48:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Lock "cinder-quobyte-a8e336a4-77da-42e1-888c-d9abeb924fd5" acquired by "delete_volume" :: waited 0.037s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:48:42 devstack cinder-volume[86676]: INFO oslo.privsep.daemon [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5j9_s5xp/privsep.sock'] Jul 03 23:48:42 devstack sudo[87667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5j9_s5xp/privsep.sock Jul 03 23:48:42 devstack sudo[87667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:48:44 devstack cinder-volume[86676]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 03 23:48:44 devstack cinder-volume[86676]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 23:48:44 devstack cinder-volume[86676]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 23:48:44 devstack cinder-volume[86676]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 23:48:44 devstack cinder-volume[86676]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 23:48:44 devstack cinder-volume[86676]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 23:48:44 devstack cinder-volume[86676]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 23:48:44 devstack cinder-volume[86676]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 23:48:44 devstack cinder-volume[86676]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 03 23:48:45 devstack cinder-volume[86676]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 03 23:48:45 devstack cinder-volume[86676]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 23:48:45 devstack cinder-volume[86676]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 23:48:45 devstack cinder-volume[86676]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 23:48:45 devstack cinder-volume[86676]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 23:48:45 devstack cinder-volume[86676]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 23:48:45 devstack cinder-volume[86676]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 23:48:45 devstack cinder-volume[86676]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 23:48:45 devstack cinder-volume[86676]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 03 23:48:46 devstack sudo[87667]: pam_unix(sudo:session): session closed for user root Jul 03 23:48:46 devstack cinder-volume[86676]: INFO oslo.privsep.daemon [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Spawned new privsep daemon via rootwrap Jul 03 23:48:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Accepted privsep connection to /tmp/tmp5j9_s5xp/privsep.sock {{(pid=86676) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 03 23:48:46 devstack cinder-volume[86676]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 03 23:48:46 devstack cinder-volume[86676]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 03 23:48:46 devstack cinder-volume[86676]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 03 23:48:46 devstack cinder-volume[86676]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87670 Jul 03 23:48:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[42523b1d-2234-4444-84c5-79da0c5a5a33]: (2,) {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:48:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b57ba1-b223-4dbf-ae06-55aaa6dd2037]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:48:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a8e336a4-77da-42e1-888c-d9abeb924fd5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:48:46 devstack sudo[87672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a8e336a4-77da-42e1-888c-d9abeb924fd5 Jul 03 23:48:46 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:48:48 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root Jul 03 23:48:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a8e336a4-77da-42e1-888c-d9abeb924fd5" returned: 0 in 1.794s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:48:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a8e336a4-77da-42e1-888c-d9abeb924fd5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:48:48 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a8e336a4-77da-42e1-888c-d9abeb924fd5 Jul 03 23:48:48 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:48:50 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Jul 03 23:48:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a8e336a4-77da-42e1-888c-d9abeb924fd5" returned: 0 in 2.324s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:48:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Lock "cinder-quobyte-a8e336a4-77da-42e1-888c-d9abeb924fd5" released by "delete_volume" :: held 8.024s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:48:50 devstack cinder-volume[86676]: WARNING cinder.quota [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:48:50 devstack cinder-volume[86676]: WARNING cinder.quota [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:48:50 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Created reservations ['6d047ea4-eded-443f-8c85-bea36dd5101a', '1c650b61-0e00-4fdf-be3d-a6682fd0fa79', '399e6a49-37f3-4eb4-81a3-17c0d5d18a31', 'bf045de3-8f83-463a-8b70-adbec6db53c5'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:48:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:48:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:48:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:48:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:48:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:48:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:48:51 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:48:51 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:48:52 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Jul 03 23:48:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.397s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:48:52 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:48:52 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Deleted volume successfully. Jul 03 23:48:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-062fec93-4ed5-4679-9ae6-94ff8ddd008b tempest-VolumesAdminNegativeTest-1302048276 None] Lock "cinder-a8e336a4-77da-42e1-888c-d9abeb924fd5-delete_volume" released by "delete_volume" :: held 10.090s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=12,cinder:SELECT=5,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Flow 'volume_create_manager' (cc6b0de2-bdb8-4441-a2d5-3008b433d31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49b3e9e-6ce3-4d81-97f0-3f9de31fe906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49b3e9e-6ce3-4d81-97f0-3f9de31fe906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-329741913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43203f13-108e-43f0-88c1-b16f863b0ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef9f487f3204cfc8bd8d9cb3c13e4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:49:02Z,use_quota=True,user_id='275b90ef5ec34bdaa4d7d7b9066b5d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a80c4f-ef79-41e5-9daa-6ea16b387122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a80c4f-ef79-41e5-9daa-6ea16b387122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5280ca-785b-4682-856d-7c34202cc98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5280ca-785b-4682-856d-7c34202cc98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43203f13-108e-43f0-88c1-b16f863b0ab0', 'volume_name': 'volume-43203f13-108e-43f0-88c1-b16f863b0ab0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da32412-b620-4b53-a337-4f1e79b7f990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da32412-b620-4b53-a337-4f1e79b7f990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4d2f09-b718-4416-b6d8-cd354fe3e409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:49:01 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Volume 43203f13-108e-43f0-88c1-b16f863b0ab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43203f13-108e-43f0-88c1-b16f863b0ab0', 'volume_size': 1} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-329741913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43203f13-108e-43f0-88c1-b16f863b0ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef9f487f3204cfc8bd8d9cb3c13e4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:49:02Z,use_quota=True,user_id='275b90ef5ec34bdaa4d7d7b9066b5d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Creating volume 43203f13-108e-43f0-88c1-b16f863b0ab0 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:49:01 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:49:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-43203f13-108e-43f0-88c1-b16f863b0ab0 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:49:01 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-43203f13-108e-43f0-88c1-b16f863b0ab0 1073741824 Jul 03 23:49:01 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:49:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-43203f13-108e-43f0-88c1-b16f863b0ab0 1073741824" returned: 0 in 1.285s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:49:03 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Jul 03 23:49:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-43203f13-108e-43f0-88c1-b16f863b0ab0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:49:03 devstack sudo[87901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-43203f13-108e-43f0-88c1-b16f863b0ab0 Jul 03 23:49:03 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:49:04 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root Jul 03 23:49:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-43203f13-108e-43f0-88c1-b16f863b0ab0" returned: 0 in 0.769s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:49:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] <== create_volume: return (2143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:49:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.145s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:49:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4d2f09-b718-4416-b6d8-cd354fe3e409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43203f13-108e-43f0-88c1-b16f863b0ab0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:49:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301e311f-8a3f-4fb3-9b6e-5d7efa47abed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:49:04 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Volume volume-43203f13-108e-43f0-88c1-b16f863b0ab0 (43203f13-108e-43f0-88c1-b16f863b0ab0): created successfully Jul 03 23:49:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301e311f-8a3f-4fb3-9b6e-5d7efa47abed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:49:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Flow 'volume_create_manager' (cc6b0de2-bdb8-4441-a2d5-3008b433d31a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:49:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-cc367462-15db-4b5b-9bab-daf39f9d3ede tempest-AttachVolumeNegativeTest-1105301848 None] Created volume successfully. Jul 03 23:49:12 devstack cinder-volume[86676]: WARNING py.warnings [req-7dbec241-5601-49f9-b4f7-9db7f8ca9fa3 req-8867e768-63e7-4d4a-bb83-c20198717eca tempest-AttachVolumeNegativeTest-1105301848 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 03 23:49:12 devstack cinder-volume[86676]: .first() Jul 03 23:49:12 devstack cinder-volume[86676]: Jul 03 23:49:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-7dbec241-5601-49f9-b4f7-9db7f8ca9fa3 req-8867e768-63e7-4d4a-bb83-c20198717eca tempest-AttachVolumeNegativeTest-1105301848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:49:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-7dbec241-5601-49f9-b4f7-9db7f8ca9fa3 req-8867e768-63e7-4d4a-bb83-c20198717eca tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:49:12 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd42a44-c8fa-4fc3-84b3-9b127569de63]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:49:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-7dbec241-5601-49f9-b4f7-9db7f8ca9fa3 req-8867e768-63e7-4d4a-bb83-c20198717eca tempest-AttachVolumeNegativeTest-1105301848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-43203f13-108e-43f0-88c1-b16f863b0ab0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:49:13 devstack sudo[88059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-43203f13-108e-43f0-88c1-b16f863b0ab0 Jul 03 23:49:13 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:49:14 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=12,cinder:INSERT=4,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:49:14 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root Jul 03 23:49:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-7dbec241-5601-49f9-b4f7-9db7f8ca9fa3 req-8867e768-63e7-4d4a-bb83-c20198717eca tempest-AttachVolumeNegativeTest-1105301848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-43203f13-108e-43f0-88c1-b16f863b0ab0" returned: 0 in 1.519s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:49:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-7dbec241-5601-49f9-b4f7-9db7f8ca9fa3 req-8867e768-63e7-4d4a-bb83-c20198717eca tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.577s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:49:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-7dbec241-5601-49f9-b4f7-9db7f8ca9fa3 req-8867e768-63e7-4d4a-bb83-c20198717eca tempest-AttachVolumeNegativeTest-1105301848 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-43203f13-108e-43f0-88c1-b16f863b0ab0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc2ce31c-4dfe-4a8e-b671-74e1d0a0a75a', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 03 23:49:14 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-7dbec241-5601-49f9-b4f7-9db7f8ca9fa3 req-8867e768-63e7-4d4a-bb83-c20198717eca tempest-AttachVolumeNegativeTest-1105301848 None] attachment_update completed successfully. Jul 03 23:49:24 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:49:24 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=10,cinder:UPDATE=7 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Flow 'volume_create_manager' (08a49c85-0675-432a-9e08-26f6270d7817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb8b830-7815-4b69-9c74-c2cff30cafd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb8b830-7815-4b69-9c74-c2cff30cafd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2118693436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b83383-1988-4dac-aede-67b6505dccaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37bf17279c7d490d9aaf04fadfa6f0a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:49:29Z,use_quota=True,user_id='55e99361341741cc80ac4063d1bd8348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c51737-91b0-4534-b2a7-002625d07684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c51737-91b0-4534-b2a7-002625d07684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161a2520-6362-47b0-b4a3-a89cf70f51ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161a2520-6362-47b0-b4a3-a89cf70f51ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9b83383-1988-4dac-aede-67b6505dccaa', 'volume_name': 'volume-b9b83383-1988-4dac-aede-67b6505dccaa', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156be1b1-e055-41f0-81cd-5d05954e7b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156be1b1-e055-41f0-81cd-5d05954e7b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffd36bc-820b-4e8e-87b6-5f6bdaddf125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:49:28 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Volume b9b83383-1988-4dac-aede-67b6505dccaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9b83383-1988-4dac-aede-67b6505dccaa', 'volume_size': 1} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2118693436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b83383-1988-4dac-aede-67b6505dccaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37bf17279c7d490d9aaf04fadfa6f0a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:49:29Z,use_quota=True,user_id='55e99361341741cc80ac4063d1bd8348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Creating volume b9b83383-1988-4dac-aede-67b6505dccaa {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:49:28 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9b83383-1988-4dac-aede-67b6505dccaa 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:49:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-23fbee58-bcdf-4f11-93eb-5d8b4cf1cbd2 req-9aa07dfb-6fb4-4add-af2e-6bf736c7f21c tempest-TaggedAttachmentsTest-1499948303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:49:28 devstack sudo[88629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9b83383-1988-4dac-aede-67b6505dccaa 1073741824 Jul 03 23:49:28 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:49:29 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root Jul 03 23:49:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9b83383-1988-4dac-aede-67b6505dccaa 1073741824" returned: 0 in 0.987s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:49:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9b83383-1988-4dac-aede-67b6505dccaa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:49:29 devstack sudo[88635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9b83383-1988-4dac-aede-67b6505dccaa Jul 03 23:49:29 devstack sudo[88635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:49:31 devstack sudo[88635]: pam_unix(sudo:session): session closed for user root Jul 03 23:49:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9b83383-1988-4dac-aede-67b6505dccaa" returned: 0 in 1.153s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:49:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] <== create_volume: return (2192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:49:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.197s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:49:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-23fbee58-bcdf-4f11-93eb-5d8b4cf1cbd2 req-9aa07dfb-6fb4-4add-af2e-6bf736c7f21c tempest-TaggedAttachmentsTest-1499948303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.175s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:49:31 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f393d107-2b66-47bf-8df9-7493e530348a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:49:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-23fbee58-bcdf-4f11-93eb-5d8b4cf1cbd2 req-9aa07dfb-6fb4-4add-af2e-6bf736c7f21c tempest-TaggedAttachmentsTest-1499948303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-433cf579-617d-45e4-9eeb-006b39ee7deb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:49:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffd36bc-820b-4e8e-87b6-5f6bdaddf125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9b83383-1988-4dac-aede-67b6505dccaa', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:49:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585ed17c-c1fa-424f-bdc5-c380c166eea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:49:31 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Volume volume-b9b83383-1988-4dac-aede-67b6505dccaa (b9b83383-1988-4dac-aede-67b6505dccaa): created successfully Jul 03 23:49:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585ed17c-c1fa-424f-bdc5-c380c166eea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:49:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Flow 'volume_create_manager' (08a49c85-0675-432a-9e08-26f6270d7817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:49:31 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8d9a2811-13af-4db3-9131-366aa66a811d tempest-ServerRescueNegativeTestJSON-272438130 None] Created volume successfully. Jul 03 23:49:31 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-433cf579-617d-45e4-9eeb-006b39ee7deb Jul 03 23:49:31 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:49:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:49:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:49:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:49:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:49:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:49:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:49:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:49:33 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Jul 03 23:49:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-23fbee58-bcdf-4f11-93eb-5d8b4cf1cbd2 req-9aa07dfb-6fb4-4add-af2e-6bf736c7f21c tempest-TaggedAttachmentsTest-1499948303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-433cf579-617d-45e4-9eeb-006b39ee7deb" returned: 0 in 2.112s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:49:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-23fbee58-bcdf-4f11-93eb-5d8b4cf1cbd2 req-9aa07dfb-6fb4-4add-af2e-6bf736c7f21c tempest-TaggedAttachmentsTest-1499948303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.163s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:49:33 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:49:33 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:49:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-23fbee58-bcdf-4f11-93eb-5d8b4cf1cbd2 req-9aa07dfb-6fb4-4add-af2e-6bf736c7f21c tempest-TaggedAttachmentsTest-1499948303 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-433cf579-617d-45e4-9eeb-006b39ee7deb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6eaff475-a935-4e93-8ce9-f188229f4e49', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 03 23:49:33 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-23fbee58-bcdf-4f11-93eb-5d8b4cf1cbd2 req-9aa07dfb-6fb4-4add-af2e-6bf736c7f21c tempest-TaggedAttachmentsTest-1499948303 None] attachment_update completed successfully. Jul 03 23:49:34 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Jul 03 23:49:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.213s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:49:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:49:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:49:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 8 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 23:49:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 03 23:49:43 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:49:43 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:49:44 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-b53e014e-f65e-4611-ba45-8308dccea913 req-f57e2f35-f176-4622-b9c5-aa9585290bed tempest-TaggedAttachmentsTest-1499948303 None] Terminate volume connection completed successfully. Jul 03 23:49:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-b53e014e-f65e-4611-ba45-8308dccea913 req-f57e2f35-f176-4622-b9c5-aa9585290bed tempest-TaggedAttachmentsTest-1499948303 None] Deleting attachment 6eaff475-a935-4e93-8ce9-f188229f4e49. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 03 23:49:54 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:49:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] Acquiring lock "cinder-b9b83383-1988-4dac-aede-67b6505dccaa-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:49:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] Lock "cinder-b9b83383-1988-4dac-aede-67b6505dccaa-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:49:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] Acquiring lock "cinder-quobyte-b9b83383-1988-4dac-aede-67b6505dccaa" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:49:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] Lock "cinder-quobyte-b9b83383-1988-4dac-aede-67b6505dccaa" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:49:55 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fc3b87-3351-4976-9507-cb64074bed28]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:49:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9b83383-1988-4dac-aede-67b6505dccaa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:49:55 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9b83383-1988-4dac-aede-67b6505dccaa Jul 03 23:49:55 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:49:56 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Jul 03 23:49:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9b83383-1988-4dac-aede-67b6505dccaa" returned: 0 in 1.231s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:49:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9b83383-1988-4dac-aede-67b6505dccaa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:49:56 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9b83383-1988-4dac-aede-67b6505dccaa Jul 03 23:49:56 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:49:58 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Jul 03 23:49:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9b83383-1988-4dac-aede-67b6505dccaa" returned: 0 in 1.486s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:49:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] Lock "cinder-quobyte-b9b83383-1988-4dac-aede-67b6505dccaa" released by "delete_volume" :: held 2.784s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:49:58 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] Created reservations ['5705f9d5-6fed-475f-b65d-f59f1eac33f6', 'c57e9e05-4aef-4f37-b5de-a3ac375ac277', '470b3bbd-1e95-43ef-8243-4dc81a9f4b2b', 'fa93567e-48b7-4c28-ad0d-f106967a413c'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:49:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:49:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:49:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:49:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:49:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:49:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:49:58 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:49:58 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:49:59 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Jul 03 23:49:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.305s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:49:59 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:49:59 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] Deleted volume successfully. Jul 03 23:49:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c1d6321b-807a-4799-8081-9f4e2d8ed575 tempest-ServerRescueNegativeTestJSON-272438130 None] Lock "cinder-b9b83383-1988-4dac-aede-67b6505dccaa-delete_volume" released by "delete_volume" :: held 4.501s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:50:08 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4,cinder:INSERT=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:50:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] Acquiring lock "cinder-433cf579-617d-45e4-9eeb-006b39ee7deb-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:50:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] Lock "cinder-433cf579-617d-45e4-9eeb-006b39ee7deb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:50:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] Acquiring lock "cinder-quobyte-433cf579-617d-45e4-9eeb-006b39ee7deb" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:50:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] Lock "cinder-quobyte-433cf579-617d-45e4-9eeb-006b39ee7deb" acquired by "delete_volume" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:50:09 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2950a923-1515-49df-a249-cbc99e7bdc09]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:50:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-433cf579-617d-45e4-9eeb-006b39ee7deb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:50:09 devstack sudo[89117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-433cf579-617d-45e4-9eeb-006b39ee7deb Jul 03 23:50:09 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:50:11 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root Jul 03 23:50:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-433cf579-617d-45e4-9eeb-006b39ee7deb" returned: 0 in 1.441s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:50:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-433cf579-617d-45e4-9eeb-006b39ee7deb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:50:11 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-433cf579-617d-45e4-9eeb-006b39ee7deb Jul 03 23:50:11 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:50:12 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Jul 03 23:50:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-433cf579-617d-45e4-9eeb-006b39ee7deb" returned: 0 in 1.276s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:50:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] Lock "cinder-quobyte-433cf579-617d-45e4-9eeb-006b39ee7deb" released by "delete_volume" :: held 2.815s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:50:12 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] Created reservations ['eb25d2b4-f619-433c-a2df-978afc8b9b04', '8874648f-67ce-4709-a824-3c6b392d53d4', 'ebab7632-ecaf-462d-952b-f5a9b2e4d644', 'c037f146-a1aa-49da-aa1d-057d029402ec'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:50:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:50:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:50:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:50:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:50:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:50:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:50:12 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:50:12 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:50:12 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Flow 'volume_create_manager' (777990a3-0369-4825-adcb-bb8d65c2f23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb07b0c2-f6d6-4a65-8807-ee0972536d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb07b0c2-f6d6-4a65-8807-ee0972536d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1332565915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=055f858b-75e7-440c-963a-9f88b4f1d505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceafd47da2374c1b9a5e0bfa14e9f420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:50:13Z,use_quota=True,user_id='ba4331bfdee04128a4ca5bc2293bac46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bd075c-43a9-456e-b992-c5f1addea1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bd075c-43a9-456e-b992-c5f1addea1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34ceb18-58e1-415d-8ec2-e3db631ac1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34ceb18-58e1-415d-8ec2-e3db631ac1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '055f858b-75e7-440c-963a-9f88b4f1d505', 'volume_name': 'volume-055f858b-75e7-440c-963a-9f88b4f1d505', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a627f12-b383-4e11-9b32-b674b55aec22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a627f12-b383-4e11-9b32-b674b55aec22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b00c94-4823-48d0-a009-63c8ee1138e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:50:13 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Volume 055f858b-75e7-440c-963a-9f88b4f1d505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-055f858b-75e7-440c-963a-9f88b4f1d505', 'volume_size': 1} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1332565915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=055f858b-75e7-440c-963a-9f88b4f1d505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceafd47da2374c1b9a5e0bfa14e9f420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:50:13Z,use_quota=True,user_id='ba4331bfdee04128a4ca5bc2293bac46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Creating volume 055f858b-75e7-440c-963a-9f88b4f1d505 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:50:13 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:50:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055f858b-75e7-440c-963a-9f88b4f1d505 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:50:13 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055f858b-75e7-440c-963a-9f88b4f1d505 1073741824 Jul 03 23:50:13 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:50:14 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Jul 03 23:50:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.598s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:50:14 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:50:14 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] Deleted volume successfully. Jul 03 23:50:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a26665a5-963d-4f8d-9469-133e261c5212 tempest-TaggedAttachmentsTest-1499948303 None] Lock "cinder-433cf579-617d-45e4-9eeb-006b39ee7deb-delete_volume" released by "delete_volume" :: held 4.764s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:50:15 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Jul 03 23:50:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055f858b-75e7-440c-963a-9f88b4f1d505 1073741824" returned: 0 in 1.813s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:50:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055f858b-75e7-440c-963a-9f88b4f1d505 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:50:15 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055f858b-75e7-440c-963a-9f88b4f1d505 Jul 03 23:50:15 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:50:16 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Jul 03 23:50:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055f858b-75e7-440c-963a-9f88b4f1d505" returned: 0 in 0.973s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:50:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] <== create_volume: return (2889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:50:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.895s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:50:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b00c94-4823-48d0-a009-63c8ee1138e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-055f858b-75e7-440c-963a-9f88b4f1d505', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:50:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff65540-c0b9-4c4b-9891-02c6b8abd859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:50:16 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Volume volume-055f858b-75e7-440c-963a-9f88b4f1d505 (055f858b-75e7-440c-963a-9f88b4f1d505): created successfully Jul 03 23:50:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff65540-c0b9-4c4b-9891-02c6b8abd859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:50:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Flow 'volume_create_manager' (777990a3-0369-4825-adcb-bb8d65c2f23d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:50:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-feed4d41-ce6a-4451-8a45-c6e6849fd44a tempest-DeleteServersTestJSON-724928952 None] Created volume successfully. Jul 03 23:50:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-2837ee65-44ec-4319-a000-ae01e98dcb5f req-bc6bc469-31cb-40e2-87fd-dc2341c0195a tempest-DeleteServersTestJSON-724928952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:50:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-2837ee65-44ec-4319-a000-ae01e98dcb5f req-bc6bc469-31cb-40e2-87fd-dc2341c0195a tempest-DeleteServersTestJSON-724928952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:50:20 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9747b7a-ab8a-4bc2-a8d1-906262d6ad0b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:50:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-2837ee65-44ec-4319-a000-ae01e98dcb5f req-bc6bc469-31cb-40e2-87fd-dc2341c0195a tempest-DeleteServersTestJSON-724928952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055f858b-75e7-440c-963a-9f88b4f1d505 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:50:21 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055f858b-75e7-440c-963a-9f88b4f1d505 Jul 03 23:50:21 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:50:21 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Jul 03 23:50:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-2837ee65-44ec-4319-a000-ae01e98dcb5f req-bc6bc469-31cb-40e2-87fd-dc2341c0195a tempest-DeleteServersTestJSON-724928952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055f858b-75e7-440c-963a-9f88b4f1d505" returned: 0 in 0.946s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:50:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-2837ee65-44ec-4319-a000-ae01e98dcb5f req-bc6bc469-31cb-40e2-87fd-dc2341c0195a tempest-DeleteServersTestJSON-724928952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.963s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:50:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-2837ee65-44ec-4319-a000-ae01e98dcb5f req-bc6bc469-31cb-40e2-87fd-dc2341c0195a tempest-DeleteServersTestJSON-724928952 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-055f858b-75e7-440c-963a-9f88b4f1d505', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'baa05cda-8535-4c98-a63b-395b0004ed96', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 03 23:50:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-2837ee65-44ec-4319-a000-ae01e98dcb5f req-bc6bc469-31cb-40e2-87fd-dc2341c0195a tempest-DeleteServersTestJSON-724928952 None] attachment_update completed successfully. Jul 03 23:50:24 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-64d7af74-738b-4ba6-9e92-20bbf7b9e7f7 req-c3835798-a6f8-4a1b-86c2-755f612c9e8f tempest-AttachVolumeNegativeTest-1105301848 None] Terminate volume connection completed successfully. Jul 03 23:50:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-64d7af74-738b-4ba6-9e92-20bbf7b9e7f7 req-c3835798-a6f8-4a1b-86c2-755f612c9e8f tempest-AttachVolumeNegativeTest-1105301848 None] Deleting attachment bc2ce31c-4dfe-4a8e-b671-74e1d0a0a75a. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 03 23:50:32 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=11,cinder:UPDATE=14,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:50:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:50:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:50:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:50:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:50:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:50:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:50:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:50:33 devstack sudo[89321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:50:33 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:50:33 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root Jul 03 23:50:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.776s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:50:33 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:50:34 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=22,cinder:INSERT=6,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:50:34 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-6c0de770-481a-4df9-beb6-67322f717f72 req-5b3f87f5-ba2b-4cf4-9084-c69227cc8391 tempest-DeleteServersTestJSON-724928952 None] Terminate volume connection completed successfully. Jul 03 23:50:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-6c0de770-481a-4df9-beb6-67322f717f72 req-5b3f87f5-ba2b-4cf4-9084-c69227cc8391 tempest-DeleteServersTestJSON-724928952 None] Deleting attachment baa05cda-8535-4c98-a63b-395b0004ed96. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 03 23:50:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] Acquiring lock "cinder-055f858b-75e7-440c-963a-9f88b4f1d505-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:50:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] Lock "cinder-055f858b-75e7-440c-963a-9f88b4f1d505-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:50:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] Acquiring lock "cinder-quobyte-055f858b-75e7-440c-963a-9f88b4f1d505" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:50:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] Lock "cinder-quobyte-055f858b-75e7-440c-963a-9f88b4f1d505" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:50:38 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6cc613-eb60-41dd-863e-d7fc06daa160]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:50:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055f858b-75e7-440c-963a-9f88b4f1d505 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:50:38 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055f858b-75e7-440c-963a-9f88b4f1d505 Jul 03 23:50:38 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:50:39 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Jul 03 23:50:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055f858b-75e7-440c-963a-9f88b4f1d505" returned: 0 in 0.977s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:50:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055f858b-75e7-440c-963a-9f88b4f1d505 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:50:39 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055f858b-75e7-440c-963a-9f88b4f1d505 Jul 03 23:50:39 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:50:40 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Jul 03 23:50:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055f858b-75e7-440c-963a-9f88b4f1d505" returned: 0 in 0.783s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:50:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] Lock "cinder-quobyte-055f858b-75e7-440c-963a-9f88b4f1d505" released by "delete_volume" :: held 1.816s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:50:40 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] Created reservations ['7c24414b-2d79-4baa-8aae-4952dc263c74', '39f1733c-37ba-471c-8bb0-4e372621f289', 'a3faaea1-2e55-4f8b-80f3-cca4063fd299', '60a5d760-dec6-4da3-8cb8-ef9b811009a2'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:50:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:50:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:50:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:50:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:50:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:50:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:50:40 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:50:40 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:50:41 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Jul 03 23:50:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.890s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:50:41 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:50:41 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] Deleted volume successfully. Jul 03 23:50:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3191a640-b248-445b-a4fc-469e43b49da4 tempest-DeleteServersTestJSON-724928952 None] Lock "cinder-055f858b-75e7-440c-963a-9f88b4f1d505-delete_volume" released by "delete_volume" :: held 2.967s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:50:50 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:50:51 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:51:11 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:51:11 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Flow 'volume_create_manager' (8fb12e1c-2874-43c3-8133-5f8b05a09605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70de6d11-f5ab-41cc-a310-d9818c377029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70de6d11-f5ab-41cc-a310-d9818c377029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1892161058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fa8cb2-66af-450d-98e2-8ca831b6af0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef9f487f3204cfc8bd8d9cb3c13e4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:33Z,use_quota=True,user_id='275b90ef5ec34bdaa4d7d7b9066b5d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2769ccf2-9ced-440a-996e-dd15bf27fdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2769ccf2-9ced-440a-996e-dd15bf27fdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81749b04-5e0a-418b-a615-96c39cf8a36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81749b04-5e0a-418b-a615-96c39cf8a36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13fa8cb2-66af-450d-98e2-8ca831b6af0b', 'volume_name': 'volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363400bc-08c3-4912-8a80-230e9b34b93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363400bc-08c3-4912-8a80-230e9b34b93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fdf7277-c2ab-463a-9bdc-18fabf4798a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:32 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Volume 13fa8cb2-66af-450d-98e2-8ca831b6af0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b', 'volume_size': 1} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1892161058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fa8cb2-66af-450d-98e2-8ca831b6af0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef9f487f3204cfc8bd8d9cb3c13e4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:33Z,use_quota=True,user_id='275b90ef5ec34bdaa4d7d7b9066b5d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Creating volume 13fa8cb2-66af-450d-98e2-8ca831b6af0b {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:51:32 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:51:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:51:33 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b 1073741824 Jul 03 23:51:33 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:51:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:51:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:51:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:51:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:51:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:51:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:51:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:51:33 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:51:33 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:51:34 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.823s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:51:34 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 8 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b 1073741824" returned: 0 in 1.081s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:51:34 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b Jul 03 23:51:34 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Flow 'volume_create_manager' (b0fcc7af-8598-4953-af47-c3b418802294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9075d4-9ae1-438a-9004-9db57728a9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9075d4-9ae1-438a-9004-9db57728a9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-691188604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e7983e-3785-4879-80e2-bd6976e4aa0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de17af8a8dfc4b88885adec563239fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:35Z,use_quota=True,user_id='8fbd5e5080fd448ba86771178d2496e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb061b2b-f9c4-4a63-8694-241bd274f110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb061b2b-f9c4-4a63-8694-241bd274f110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76fdffb7-d3a2-4387-83b0-b35d4231b39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76fdffb7-d3a2-4387-83b0-b35d4231b39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2e7983e-3785-4879-80e2-bd6976e4aa0c', 'volume_name': 'volume-c2e7983e-3785-4879-80e2-bd6976e4aa0c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d0e254-63e2-4bb5-952c-e91a4e9d8af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d0e254-63e2-4bb5-952c-e91a4e9d8af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e1a253b-0d7a-4cf1-b465-219e8eb47624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:34 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Volume c2e7983e-3785-4879-80e2-bd6976e4aa0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2e7983e-3785-4879-80e2-bd6976e4aa0c', 'volume_size': 1} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:51:34 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b" returned: 0 in 0.700s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.129s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-691188604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e7983e-3785-4879-80e2-bd6976e4aa0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de17af8a8dfc4b88885adec563239fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:35Z,use_quota=True,user_id='8fbd5e5080fd448ba86771178d2496e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Creating volume c2e7983e-3785-4879-80e2-bd6976e4aa0c {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:51:34 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c2e7983e-3785-4879-80e2-bd6976e4aa0c 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fdf7277-c2ab-463a-9bdc-18fabf4798a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:34 devstack sudo[89831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c2e7983e-3785-4879-80e2-bd6976e4aa0c 1073741824 Jul 03 23:51:34 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc2af72-8b34-4884-b3ef-8bce766fdc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:34 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Volume volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b (13fa8cb2-66af-450d-98e2-8ca831b6af0b): created successfully Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc2af72-8b34-4884-b3ef-8bce766fdc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Flow 'volume_create_manager' (8fb12e1c-2874-43c3-8133-5f8b05a09605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:51:34 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9fe124d0-98fd-489d-a764-53097704161a tempest-AttachVolumeNegativeTest-1105301848 None] Created volume successfully. Jul 03 23:51:35 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root Jul 03 23:51:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c2e7983e-3785-4879-80e2-bd6976e4aa0c 1073741824" returned: 0 in 0.907s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:51:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c2e7983e-3785-4879-80e2-bd6976e4aa0c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:51:35 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c2e7983e-3785-4879-80e2-bd6976e4aa0c Jul 03 23:51:35 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Flow 'volume_create_manager' (39df6e2b-48b8-4f8b-a3ae-10f35bb8ea5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9335ef-14f0-4846-9fcf-04fc74356f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9335ef-14f0-4846-9fcf-04fc74356f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1985611045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fdad03a-5711-4bc1-a1fc-05403fd6a448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0c437529e34685851880ac7930d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:36Z,use_quota=True,user_id='8486ec1c00f845659dd33823ee41fb49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ca7814-f6c4-464b-bf40-1e44f70a57bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ca7814-f6c4-464b-bf40-1e44f70a57bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e01ca7f-faaf-429d-865a-bdb000db3bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e01ca7f-faaf-429d-865a-bdb000db3bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fdad03a-5711-4bc1-a1fc-05403fd6a448', 'volume_name': 'volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1d5e31-92d2-4e83-a4b4-3e28cdbeaed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1d5e31-92d2-4e83-a4b4-3e28cdbeaed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc47df86-5539-4d6e-9109-a167feabeb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:36 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Volume 9fdad03a-5711-4bc1-a1fc-05403fd6a448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448', 'volume_size': 1} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:51:36 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c2e7983e-3785-4879-80e2-bd6976e4aa0c" returned: 0 in 0.733s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.265s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1985611045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fdad03a-5711-4bc1-a1fc-05403fd6a448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0c437529e34685851880ac7930d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:36Z,use_quota=True,user_id='8486ec1c00f845659dd33823ee41fb49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Creating volume 9fdad03a-5711-4bc1-a1fc-05403fd6a448 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:51:36 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:51:36 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448 1073741824 Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e1a253b-0d7a-4cf1-b465-219e8eb47624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2e7983e-3785-4879-80e2-bd6976e4aa0c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:36 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f34174-62ac-4e29-a29e-d950c7e75759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:36 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Volume volume-c2e7983e-3785-4879-80e2-bd6976e4aa0c (c2e7983e-3785-4879-80e2-bd6976e4aa0c): created successfully Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f34174-62ac-4e29-a29e-d950c7e75759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Flow 'volume_create_manager' (b0fcc7af-8598-4953-af47-c3b418802294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:51:36 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1a6a6bd3-eb57-48b4-a0f4-c37e589755b8 tempest-AttachVolumeShelveTestJSON-1069869840 None] Created volume successfully. Jul 03 23:51:37 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Jul 03 23:51:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448 1073741824" returned: 0 in 0.925s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:51:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:51:37 devstack sudo[89857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448 Jul 03 23:51:37 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:51:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-146b111d-e511-4bf2-acc6-ad4a6a405aba req-2631d197-183d-4bd4-98a3-bd1158e7caef tempest-AttachVolumeNegativeTest-1105301848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:51:38 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root Jul 03 23:51:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448" returned: 0 in 0.779s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:51:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:51:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-146b111d-e511-4bf2-acc6-ad4a6a405aba req-2631d197-183d-4bd4-98a3-bd1158e7caef tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.080s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc47df86-5539-4d6e-9109-a167feabeb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a01308a8-f3ac-487e-a58e-19b1fa130d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:38 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[097cdc30-dde8-4f45-a8f0-80dadffca038]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:51:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-146b111d-e511-4bf2-acc6-ad4a6a405aba req-2631d197-183d-4bd4-98a3-bd1158e7caef tempest-AttachVolumeNegativeTest-1105301848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:51:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Volume volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448 (9fdad03a-5711-4bc1-a1fc-05403fd6a448): created successfully Jul 03 23:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a01308a8-f3ac-487e-a58e-19b1fa130d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Flow 'volume_create_manager' (39df6e2b-48b8-4f8b-a3ae-10f35bb8ea5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:51:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2dce36b7-528e-40ba-8cb7-6c4762868eb5 tempest-AttachVolumeTestJSON-2023149251 None] Created volume successfully. Jul 03 23:51:38 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b Jul 03 23:51:38 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:51:39 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Jul 03 23:51:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-146b111d-e511-4bf2-acc6-ad4a6a405aba req-2631d197-183d-4bd4-98a3-bd1158e7caef tempest-AttachVolumeNegativeTest-1105301848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b" returned: 0 in 0.872s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:51:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-146b111d-e511-4bf2-acc6-ad4a6a405aba req-2631d197-183d-4bd4-98a3-bd1158e7caef tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.917s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:51:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-146b111d-e511-4bf2-acc6-ad4a6a405aba req-2631d197-183d-4bd4-98a3-bd1158e7caef tempest-AttachVolumeNegativeTest-1105301848 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '719fbf75-d8a0-4994-8858-3ee1073de729', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 03 23:51:39 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-146b111d-e511-4bf2-acc6-ad4a6a405aba req-2631d197-183d-4bd4-98a3-bd1158e7caef tempest-AttachVolumeNegativeTest-1105301848 None] attachment_update completed successfully. Jul 03 23:51:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-c8e31104-9cbd-4b0a-aa21-ab63b6e73a16 req-72e04c8d-e807-4403-b7ca-f9c2b8fed848 tempest-AttachVolumeTestJSON-2023149251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:51:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-c8e31104-9cbd-4b0a-aa21-ab63b6e73a16 req-72e04c8d-e807-4403-b7ca-f9c2b8fed848 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:51:42 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e035b5-0fcc-4594-84e2-29b89a58f0d2]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:51:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c8e31104-9cbd-4b0a-aa21-ab63b6e73a16 req-72e04c8d-e807-4403-b7ca-f9c2b8fed848 tempest-AttachVolumeTestJSON-2023149251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:51:42 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448 Jul 03 23:51:42 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:51:43 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Jul 03 23:51:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c8e31104-9cbd-4b0a-aa21-ab63b6e73a16 req-72e04c8d-e807-4403-b7ca-f9c2b8fed848 tempest-AttachVolumeTestJSON-2023149251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448" returned: 0 in 0.813s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:51:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-c8e31104-9cbd-4b0a-aa21-ab63b6e73a16 req-72e04c8d-e807-4403-b7ca-f9c2b8fed848 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.835s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:51:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-c8e31104-9cbd-4b0a-aa21-ab63b6e73a16 req-72e04c8d-e807-4403-b7ca-f9c2b8fed848 tempest-AttachVolumeTestJSON-2023149251 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6800fcc0-2870-4901-9b2f-3db5db3efa53', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 03 23:51:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-c8e31104-9cbd-4b0a-aa21-ab63b6e73a16 req-72e04c8d-e807-4403-b7ca-f9c2b8fed848 tempest-AttachVolumeTestJSON-2023149251 None] attachment_update completed successfully. Jul 03 23:51:46 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-fbdd0337-5372-413b-9ddc-0f7911bab93a req-940da0d7-73fc-4f5f-933e-717471d12a80 tempest-AttachVolumeNegativeTest-1105301848 None] Terminate volume connection completed successfully. Jul 03 23:51:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-fbdd0337-5372-413b-9ddc-0f7911bab93a req-940da0d7-73fc-4f5f-933e-717471d12a80 tempest-AttachVolumeNegativeTest-1105301848 None] Deleting attachment 719fbf75-d8a0-4994-8858-3ee1073de729. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Flow 'volume_create_manager' (94c670ac-72d8-46b4-a7db-5999166e973f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414e0cd2-8c0e-49d0-b7e5-a12384e5cefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414e0cd2-8c0e-49d0-b7e5-a12384e5cefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-331474408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e99eb50-1151-4618-9ce1-89570c691138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7283dd914d834a9085f5b4c612ea50ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:52Z,use_quota=True,user_id='e6a04acbf6044b498d017321ba1e0c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b929c59-7a7c-46b1-9d75-a5fa2a267fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b929c59-7a7c-46b1-9d75-a5fa2a267fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f80dd77-42e4-442f-84f1-025e8b7409f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f80dd77-42e4-442f-84f1-025e8b7409f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e99eb50-1151-4618-9ce1-89570c691138', 'volume_name': 'volume-4e99eb50-1151-4618-9ce1-89570c691138', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64096231-3052-4e45-8cb7-c4bf89a7873c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64096231-3052-4e45-8cb7-c4bf89a7873c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93abc83-8307-4d2c-b8d2-b2f49f6320b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:52 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Volume 4e99eb50-1151-4618-9ce1-89570c691138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e99eb50-1151-4618-9ce1-89570c691138', 'volume_size': 1} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-331474408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e99eb50-1151-4618-9ce1-89570c691138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7283dd914d834a9085f5b4c612ea50ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:52Z,use_quota=True,user_id='e6a04acbf6044b498d017321ba1e0c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Creating volume 4e99eb50-1151-4618-9ce1-89570c691138 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:51:52 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:51:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4e99eb50-1151-4618-9ce1-89570c691138 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:51:52 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4e99eb50-1151-4618-9ce1-89570c691138 1073741824 Jul 03 23:51:52 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:51:53 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Jul 03 23:51:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4e99eb50-1151-4618-9ce1-89570c691138 1073741824" returned: 0 in 1.250s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:51:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4e99eb50-1151-4618-9ce1-89570c691138 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:51:53 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4e99eb50-1151-4618-9ce1-89570c691138 Jul 03 23:51:53 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:51:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-500c6a96-c5b5-4309-9740-a32b177d3313 req-34866279-ce22-4ea0-8a5c-4de05902e6a4 tempest-AttachVolumeShelveTestJSON-1069869840 None] No connector for attachment 599bc700-0e23-4aa8-ab54-d46612114a34; skipping storage backend terminate_connection call. {{(pid=86676) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5011}} Jul 03 23:51:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-500c6a96-c5b5-4309-9740-a32b177d3313 req-34866279-ce22-4ea0-8a5c-4de05902e6a4 tempest-AttachVolumeShelveTestJSON-1069869840 None] Deleting attachment 599bc700-0e23-4aa8-ab54-d46612114a34. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 03 23:51:54 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Jul 03 23:51:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4e99eb50-1151-4618-9ce1-89570c691138" returned: 0 in 0.856s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:51:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] <== create_volume: return (2182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:51:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.184s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:51:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93abc83-8307-4d2c-b8d2-b2f49f6320b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e99eb50-1151-4618-9ce1-89570c691138', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44afe99f-003b-4d6e-8709-d1269adbe3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:51:54 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Volume volume-4e99eb50-1151-4618-9ce1-89570c691138 (4e99eb50-1151-4618-9ce1-89570c691138): created successfully Jul 03 23:51:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44afe99f-003b-4d6e-8709-d1269adbe3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:51:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Flow 'volume_create_manager' (94c670ac-72d8-46b4-a7db-5999166e973f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:51:54 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-675bda4b-cf46-4cff-9072-6bc999aa2d0d tempest-ServerActionsTestOtherA-839083992 None] Created volume successfully. Jul 03 23:52:04 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=22,cinder:UPDATE=12,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:52:04 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=18,cinder:SELECT=20,cinder:DELETE=3 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:52:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-b25a9037-d113-40d9-9d1c-65b09120574a req-17f8b3c9-b624-4bc1-ac3d-987a34854d0a tempest-AttachVolumeTestJSON-2023149251 None] Terminate volume connection completed successfully. Jul 03 23:52:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-b25a9037-d113-40d9-9d1c-65b09120574a req-17f8b3c9-b624-4bc1-ac3d-987a34854d0a tempest-AttachVolumeTestJSON-2023149251 None] Deleting attachment 6800fcc0-2870-4901-9b2f-3db5db3efa53. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 03 23:52:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:52:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:52:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:52:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:52:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:52:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:52:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:52:33 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:52:33 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:52:34 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Jul 03 23:52:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.074s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:52:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:52:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:52:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 8 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 23:52:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 03 23:52:37 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:52:37 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:52:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-83768997-59ed-4bf0-bfe5-489fd01f4975 req-b43b940a-84fc-4d7e-94be-035bd9da1442 tempest-ServerActionsTestOtherA-839083992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:52:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-83768997-59ed-4bf0-bfe5-489fd01f4975 req-b43b940a-84fc-4d7e-94be-035bd9da1442 tempest-ServerActionsTestOtherA-839083992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:52:39 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[442d01f5-dbbe-4e46-89cf-5ea095cd8d83]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:52:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-83768997-59ed-4bf0-bfe5-489fd01f4975 req-b43b940a-84fc-4d7e-94be-035bd9da1442 tempest-ServerActionsTestOtherA-839083992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4e99eb50-1151-4618-9ce1-89570c691138 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:52:39 devstack sudo[91387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4e99eb50-1151-4618-9ce1-89570c691138 Jul 03 23:52:39 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:52:40 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root Jul 03 23:52:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-83768997-59ed-4bf0-bfe5-489fd01f4975 req-b43b940a-84fc-4d7e-94be-035bd9da1442 tempest-ServerActionsTestOtherA-839083992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4e99eb50-1151-4618-9ce1-89570c691138" returned: 0 in 1.049s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:52:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-83768997-59ed-4bf0-bfe5-489fd01f4975 req-b43b940a-84fc-4d7e-94be-035bd9da1442 tempest-ServerActionsTestOtherA-839083992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.119s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:52:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-83768997-59ed-4bf0-bfe5-489fd01f4975 req-b43b940a-84fc-4d7e-94be-035bd9da1442 tempest-ServerActionsTestOtherA-839083992 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-4e99eb50-1151-4618-9ce1-89570c691138', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72dfb256-6495-4329-a494-5a2f8570e693', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 03 23:52:40 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-83768997-59ed-4bf0-bfe5-489fd01f4975 req-b43b940a-84fc-4d7e-94be-035bd9da1442 tempest-ServerActionsTestOtherA-839083992 None] attachment_update completed successfully. Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Flow 'volume_create_manager' (2e3279d2-8565-4078-ad1f-53c5c11e94e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83521f5c-c4ac-444a-9afd-0db20429899d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83521f5c-c4ac-444a-9afd-0db20429899d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1365203884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef9f487f3204cfc8bd8d9cb3c13e4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:52:49Z,use_quota=True,user_id='275b90ef5ec34bdaa4d7d7b9066b5d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9fd5213-9ff8-44f3-b82a-1b986837069e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9fd5213-9ff8-44f3-b82a-1b986837069e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad638753-e734-425e-9c3e-aaee3b8d41ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad638753-e734-425e-9c3e-aaee3b8d41ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3', 'volume_name': 'volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01622289-b7ae-46af-a9b8-9ecef82277ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01622289-b7ae-46af-a9b8-9ecef82277ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dbe116e-8474-46cc-8907-e1647a9e3f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:52:48 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Volume 14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3', 'volume_size': 1} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1365203884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef9f487f3204cfc8bd8d9cb3c13e4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:52:49Z,use_quota=True,user_id='275b90ef5ec34bdaa4d7d7b9066b5d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Creating volume 14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:52:48 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:52:48 devstack sudo[91863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3 1073741824 Jul 03 23:52:48 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:52:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-a72f80ed-0aa4-468c-8b3c-b941419cb8db req-1328068c-9314-436f-8e0f-8f31498f2d37 tempest-ServerActionsTestOtherA-839083992 None] Terminate volume connection completed successfully. Jul 03 23:52:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-a72f80ed-0aa4-468c-8b3c-b941419cb8db req-1328068c-9314-436f-8e0f-8f31498f2d37 tempest-ServerActionsTestOtherA-839083992 None] Deleting attachment 72dfb256-6495-4329-a494-5a2f8570e693. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 03 23:52:49 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root Jul 03 23:52:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3 1073741824" returned: 0 in 0.931s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:52:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:52:49 devstack sudo[91869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3 Jul 03 23:52:49 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:52:50 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root Jul 03 23:52:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3" returned: 0 in 1.033s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:52:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] <== create_volume: return (2002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:52:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:52:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dbe116e-8474-46cc-8907-e1647a9e3f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:52:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65f913d-4c67-4283-b505-68cf5354c218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:52:50 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Volume volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3 (14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3): created successfully Jul 03 23:52:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65f913d-4c67-4283-b505-68cf5354c218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:52:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Flow 'volume_create_manager' (2e3279d2-8565-4078-ad1f-53c5c11e94e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:52:51 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-179e2006-a2f3-4994-b084-0953e5a1709b tempest-AttachVolumeNegativeTest-1105301848 None] Created volume successfully. Jul 03 23:52:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-a72f80ed-0aa4-468c-8b3c-b941419cb8db req-f8b8b3ef-238d-489b-b9b3-dd62708388f6 tempest-ServerActionsTestOtherA-839083992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:52:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-a72f80ed-0aa4-468c-8b3c-b941419cb8db req-f8b8b3ef-238d-489b-b9b3-dd62708388f6 tempest-ServerActionsTestOtherA-839083992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:52:51 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6b3759-f82e-47f5-b70d-e9be9d45e3b3]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:52:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-a72f80ed-0aa4-468c-8b3c-b941419cb8db req-f8b8b3ef-238d-489b-b9b3-dd62708388f6 tempest-ServerActionsTestOtherA-839083992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4e99eb50-1151-4618-9ce1-89570c691138 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:52:51 devstack sudo[91920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4e99eb50-1151-4618-9ce1-89570c691138 Jul 03 23:52:51 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:52:52 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root Jul 03 23:52:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-a72f80ed-0aa4-468c-8b3c-b941419cb8db req-f8b8b3ef-238d-489b-b9b3-dd62708388f6 tempest-ServerActionsTestOtherA-839083992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4e99eb50-1151-4618-9ce1-89570c691138" returned: 0 in 0.810s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:52:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-a72f80ed-0aa4-468c-8b3c-b941419cb8db req-f8b8b3ef-238d-489b-b9b3-dd62708388f6 tempest-ServerActionsTestOtherA-839083992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.826s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:52:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-a72f80ed-0aa4-468c-8b3c-b941419cb8db req-f8b8b3ef-238d-489b-b9b3-dd62708388f6 tempest-ServerActionsTestOtherA-839083992 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-4e99eb50-1151-4618-9ce1-89570c691138', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20c1da0f-c202-4159-9d06-507d204a3c93', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 03 23:52:52 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-a72f80ed-0aa4-468c-8b3c-b941419cb8db req-f8b8b3ef-238d-489b-b9b3-dd62708388f6 tempest-ServerActionsTestOtherA-839083992 None] attachment_update completed successfully. Jul 03 23:52:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-b8c906a1-faca-46b5-95fd-8ed4d019b159 req-2c360995-f1e8-4f82-abdd-96e8ae38a73e tempest-AttachVolumeNegativeTest-1105301848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:52:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-b8c906a1-faca-46b5-95fd-8ed4d019b159 req-2c360995-f1e8-4f82-abdd-96e8ae38a73e tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:52:55 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2e4bc8-3677-44b3-90b8-0bf18a2753b0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:52:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-b8c906a1-faca-46b5-95fd-8ed4d019b159 req-2c360995-f1e8-4f82-abdd-96e8ae38a73e tempest-AttachVolumeNegativeTest-1105301848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:52:55 devstack sudo[91958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3 Jul 03 23:52:55 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:52:55 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root Jul 03 23:52:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-b8c906a1-faca-46b5-95fd-8ed4d019b159 req-2c360995-f1e8-4f82-abdd-96e8ae38a73e tempest-AttachVolumeNegativeTest-1105301848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3" returned: 0 in 0.784s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:52:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-b8c906a1-faca-46b5-95fd-8ed4d019b159 req-2c360995-f1e8-4f82-abdd-96e8ae38a73e tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.801s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:52:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-b8c906a1-faca-46b5-95fd-8ed4d019b159 req-2c360995-f1e8-4f82-abdd-96e8ae38a73e tempest-AttachVolumeNegativeTest-1105301848 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd51d9f0-0f8b-4fd7-8ff4-48c05007c050', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 03 23:52:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-b8c906a1-faca-46b5-95fd-8ed4d019b159 req-2c360995-f1e8-4f82-abdd-96e8ae38a73e tempest-AttachVolumeNegativeTest-1105301848 None] attachment_update completed successfully. Jul 03 23:53:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-0c84c4a8-af69-41b5-8dc2-82b0c802f2e7 req-5dcd9415-0aca-490c-ac73-c1ea3d6757b8 tempest-AttachVolumeNegativeTest-1105301848 None] Terminate volume connection completed successfully. Jul 03 23:53:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-0c84c4a8-af69-41b5-8dc2-82b0c802f2e7 req-5dcd9415-0aca-490c-ac73-c1ea3d6757b8 tempest-AttachVolumeNegativeTest-1105301848 None] Deleting attachment bd51d9f0-0f8b-4fd7-8ff4-48c05007c050. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 03 23:53:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] Acquiring lock "cinder-c2e7983e-3785-4879-80e2-bd6976e4aa0c-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:53:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] Lock "cinder-c2e7983e-3785-4879-80e2-bd6976e4aa0c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:53:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] Acquiring lock "cinder-quobyte-c2e7983e-3785-4879-80e2-bd6976e4aa0c" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:53:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] Lock "cinder-quobyte-c2e7983e-3785-4879-80e2-bd6976e4aa0c" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:53:10 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46df82b-ffd8-4cc7-be12-6fa3f390af67]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:53:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c2e7983e-3785-4879-80e2-bd6976e4aa0c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:10 devstack sudo[92501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c2e7983e-3785-4879-80e2-bd6976e4aa0c Jul 03 23:53:10 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:11 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c2e7983e-3785-4879-80e2-bd6976e4aa0c" returned: 0 in 0.984s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c2e7983e-3785-4879-80e2-bd6976e4aa0c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:11 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c2e7983e-3785-4879-80e2-bd6976e4aa0c Jul 03 23:53:11 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:12 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c2e7983e-3785-4879-80e2-bd6976e4aa0c" returned: 0 in 0.904s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] Lock "cinder-quobyte-c2e7983e-3785-4879-80e2-bd6976e4aa0c" released by "delete_volume" :: held 1.944s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:53:12 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] Created reservations ['79dfe20d-2742-434a-8d4f-596138284e29', '6936f9b6-60e0-49a4-8dc2-245d1664db94', '252e495b-c2d5-4911-86d6-325ee405a00c', '3a11284d-c34e-40b6-becc-d74edf210ec9'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:53:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:53:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:53:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:53:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:53:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:53:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:12 devstack sudo[92539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:53:12 devstack sudo[92539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:13 devstack sudo[92539]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.801s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:13 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:53:13 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] Deleted volume successfully. Jul 03 23:53:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-30572d32-4e3b-4b13-8cdd-db61dc64ea10 tempest-AttachVolumeShelveTestJSON-1069869840 None] Lock "cinder-c2e7983e-3785-4879-80e2-bd6976e4aa0c-delete_volume" released by "delete_volume" :: held 3.026s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:53:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] Acquiring lock "cinder-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:53:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] Lock "cinder-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:53:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] Acquiring lock "cinder-quobyte-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:53:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] Lock "cinder-quobyte-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:53:15 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b227dc13-a74c-41c1-8d2f-61bfd4f3ffd4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:53:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:15 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3 Jul 03 23:53:15 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:16 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3" returned: 0 in 1.053s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:16 devstack sudo[92575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3 Jul 03 23:53:16 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:17 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3" returned: 0 in 0.806s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] Lock "cinder-quobyte-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3" released by "delete_volume" :: held 1.926s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:53:17 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] Created reservations ['9c92f640-7602-48fa-a265-5f1334298d5b', '76363290-210e-4544-80f3-f45220c4a8dd', 'e576068d-eeb0-4b51-97f8-6b1544833d22', 'f4c17d0b-1487-479e-89b6-439cd9dd9ec9'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:53:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:53:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:53:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:53:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:53:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:53:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:17 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:53:17 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] Acquiring lock "cinder-13fa8cb2-66af-450d-98e2-8ca831b6af0b-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:53:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] Lock "cinder-13fa8cb2-66af-450d-98e2-8ca831b6af0b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:53:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] Acquiring lock "cinder-quobyte-13fa8cb2-66af-450d-98e2-8ca831b6af0b" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:53:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] Lock "cinder-quobyte-13fa8cb2-66af-450d-98e2-8ca831b6af0b" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:53:17 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8303c07-e761-46f3-8abf-56197e45c576]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:53:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:17 devstack sudo[92583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b Jul 03 23:53:17 devstack sudo[92583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:18 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.970s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:18 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:53:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] Deleted volume successfully. Jul 03 23:53:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e326f39b-a2b4-4ec7-bf2c-88bbd4a8b451 tempest-AttachVolumeNegativeTest-1105301848 None] Lock "cinder-14dfeb5a-8c53-4ffc-bcb3-a7de505aaed3-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:53:18 devstack sudo[92583]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b" returned: 0 in 1.015s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:18 devstack sudo[92590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b Jul 03 23:53:18 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:19 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13fa8cb2-66af-450d-98e2-8ca831b6af0b" returned: 0 in 0.729s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] Lock "cinder-quobyte-13fa8cb2-66af-450d-98e2-8ca831b6af0b" released by "delete_volume" :: held 1.825s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:53:19 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] Created reservations ['59239c11-d09c-44fc-88f0-e6e8f7e4ec25', '5bb0b45a-9109-4dd1-b0a3-d6a46315418c', '016a5304-fa28-4521-a5bd-cb0db589b111', 'f673d422-4f2d-4ed9-8554-24d9b320e7fa'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:53:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:53:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:53:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:53:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:53:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:53:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:19 devstack sudo[92593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:53:19 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] Acquiring lock "cinder-43203f13-108e-43f0-88c1-b16f863b0ab0-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:53:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] Lock "cinder-43203f13-108e-43f0-88c1-b16f863b0ab0-delete_volume" acquired by "delete_volume" :: waited 0.119s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:53:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] Acquiring lock "cinder-quobyte-43203f13-108e-43f0-88c1-b16f863b0ab0" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:53:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] Lock "cinder-quobyte-43203f13-108e-43f0-88c1-b16f863b0ab0" acquired by "delete_volume" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:53:20 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b41e2f-ef2d-4b66-b922-1ccd25d08a4e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:53:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-43203f13-108e-43f0-88c1-b16f863b0ab0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:20 devstack sudo[92595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-43203f13-108e-43f0-88c1-b16f863b0ab0 Jul 03 23:53:20 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:20 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.060s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:20 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:53:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] Deleted volume successfully. Jul 03 23:53:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4cd6a196-e273-40b7-9578-e48b75df8e15 tempest-AttachVolumeNegativeTest-1105301848 None] Lock "cinder-13fa8cb2-66af-450d-98e2-8ca831b6af0b-delete_volume" released by "delete_volume" :: held 3.298s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:53:21 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-43203f13-108e-43f0-88c1-b16f863b0ab0" returned: 0 in 1.199s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-43203f13-108e-43f0-88c1-b16f863b0ab0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:21 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-43203f13-108e-43f0-88c1-b16f863b0ab0 Jul 03 23:53:21 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:22 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-43203f13-108e-43f0-88c1-b16f863b0ab0" returned: 0 in 0.961s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] Lock "cinder-quobyte-43203f13-108e-43f0-88c1-b16f863b0ab0" released by "delete_volume" :: held 2.206s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:53:22 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] Created reservations ['506fd443-b967-45ef-96a9-7e7d7c1186f5', '7caed002-e667-4b0b-8d26-fa6315eca6be', 'ec2acba1-c257-4dba-bdde-29d86a6c6e5a', '5f77cec8-a34d-43dd-a68f-de7c75bd3b4f'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:53:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:53:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:53:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:53:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:53:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:53:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:22 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:53:22 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:23 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.105s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:23 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:53:23 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] Deleted volume successfully. Jul 03 23:53:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b6b00546-0c3a-4eda-8a03-7614c2f57321 tempest-AttachVolumeNegativeTest-1105301848 None] Lock "cinder-43203f13-108e-43f0-88c1-b16f863b0ab0-delete_volume" released by "delete_volume" :: held 3.661s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:53:26 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-19c40442-0a00-4806-9ca1-f2d5216b6aff req-7ca280bd-1a2a-4d35-92a5-61f3e866497a tempest-ServerActionsTestOtherA-839083992 None] Terminate volume connection completed successfully. Jul 03 23:53:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-19c40442-0a00-4806-9ca1-f2d5216b6aff req-7ca280bd-1a2a-4d35-92a5-61f3e866497a tempest-ServerActionsTestOtherA-839083992 None] Deleting attachment 20c1da0f-c202-4159-9d06-507d204a3c93. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 03 23:53:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a53fdbd8-345a-42bd-b0b3-f25c68bc69fc tempest-GroupSnapshotsTest-2036801966 None] Group tempest-GroupSnapshotsTest-Group-889975947: creating Jul 03 23:53:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a53fdbd8-345a-42bd-b0b3-f25c68bc69fc tempest-GroupSnapshotsTest-2036801966 None] Group tempest-GroupSnapshotsTest-Group-889975947: created successfully Jul 03 23:53:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a53fdbd8-345a-42bd-b0b3-f25c68bc69fc tempest-GroupSnapshotsTest-2036801966 None] Create group completed successfully. Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Flow 'volume_create_manager' (901e99e4-56b7-4101-b83d-d5339fedaf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4def9edd-68dc-4101-9e64-1a1104b111ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4def9edd-68dc-4101-9e64-1a1104b111ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1434332278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36d8dd66-685e-4d29-9a78-6b69ae62ae0c,host='devstack@QuobyteHD#QuobyteHD',id=22b12422-2292-4d87-a87e-36312b66dddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c89ac31e0e49d182ffeb088372ee9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:29Z,use_quota=True,user_id='4a2f90aa79554115b2deb87d8cdb3712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d90bc54-5626-4ec1-9044-0c6f90e6a93b),volume_type_id=6d90bc54-5626-4ec1-9044-0c6f90e6a93b)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80773023-3e29-415b-9405-8c170afc6545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80773023-3e29-415b-9405-8c170afc6545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdad7c7-9397-4aee-a9db-e8ef808a543f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdad7c7-9397-4aee-a9db-e8ef808a543f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22b12422-2292-4d87-a87e-36312b66dddc', 'volume_name': 'volume-22b12422-2292-4d87-a87e-36312b66dddc', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60808bd8-862b-498c-9df5-c5ea66010228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60808bd8-862b-498c-9df5-c5ea66010228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf0c42f-3422-44d7-a110-45bbde2bbef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:53:29 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Volume 22b12422-2292-4d87-a87e-36312b66dddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22b12422-2292-4d87-a87e-36312b66dddc', 'volume_size': 1} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=36d8dd66-685e-4d29-9a78-6b69ae62ae0c,created_at=2026-07-03T21:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1434332278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36d8dd66-685e-4d29-9a78-6b69ae62ae0c,host='devstack@QuobyteHD#QuobyteHD',id=22b12422-2292-4d87-a87e-36312b66dddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c89ac31e0e49d182ffeb088372ee9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:29Z,use_quota=True,user_id='4a2f90aa79554115b2deb87d8cdb3712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d90bc54-5626-4ec1-9044-0c6f90e6a93b),volume_type_id=6d90bc54-5626-4ec1-9044-0c6f90e6a93b)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Creating volume 22b12422-2292-4d87-a87e-36312b66dddc {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:53:29 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:53:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:29 devstack sudo[92636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc 1073741824 Jul 03 23:53:29 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:31 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc 1073741824" returned: 0 in 1.930s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:31 devstack sudo[92744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc Jul 03 23:53:31 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:33 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc" returned: 0 in 1.478s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] <== create_volume: return (3506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:53:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.509s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:53:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf0c42f-3422-44d7-a110-45bbde2bbef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22b12422-2292-4d87-a87e-36312b66dddc', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:53:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45c26e2f-44a8-47b5-add6-148387a5ae13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:53:33 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Volume volume-22b12422-2292-4d87-a87e-36312b66dddc (22b12422-2292-4d87-a87e-36312b66dddc): created successfully Jul 03 23:53:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45c26e2f-44a8-47b5-add6-148387a5ae13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:53:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Flow 'volume_create_manager' (901e99e4-56b7-4101-b83d-d5339fedaf6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:53:33 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6a223ec7-d942-4b0c-872b-d9d34b1e89ec tempest-GroupSnapshotsTest-2036801966 None] Created volume successfully. Jul 03 23:53:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:53:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:53:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:53:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:53:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:53:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:53:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:33 devstack sudo[92772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:53:33 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:34 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.307s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:53:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:53:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 8 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 23:53:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 03 23:53:34 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] GroupSnapshot 7e44387d-3bac-4d13-b453-1c4e34610f2e: creating. Jul 03 23:53:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] Group snapshot 7e44387d-3bac-4d13-b453-1c4e34610f2e: creating. {{(pid=86676) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jul 03 23:53:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:53:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:53:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] Creating offline snapshot e538b740-a8e0-4d3c-bf57-5d6842b52456 of volume 22b12422-2292-4d87-a87e-36312b66dddc {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 23:53:34 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5088f5-b28c-4ac9-aafe-8d3c8d75f844]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:53:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:34 devstack sudo[92776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc Jul 03 23:53:34 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:35 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc" returned: 0 in 0.970s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:35 devstack sudo[92781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456 1G Jul 03 23:53:35 devstack sudo[92781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:37 devstack sudo[92781]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456 1G" returned: 0 in 1.168s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22b12422-2292-4d87-a87e-36312b66dddc -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:37 devstack sudo[92787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22b12422-2292-4d87-a87e-36312b66dddc -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456 Jul 03 23:53:37 devstack sudo[92787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:37 devstack sudo[92787]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22b12422-2292-4d87-a87e-36312b66dddc -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456" returned: 0 in 0.885s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:37 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 23:53:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:37 devstack sudo[92796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456 Jul 03 23:53:37 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:38 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456" returned: 0 in 0.919s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:38 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=39,cinder:UPDATE=51,cinder:DELETE=5,cinder:INSERT=10 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:53:38 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=57,cinder:INSERT=8,cinder:UPDATE=38,cinder:DELETE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:53:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:38 devstack sudo[92799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.info Jul 03 23:53:38 devstack sudo[92799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] Acquiring lock "cinder-4e99eb50-1151-4618-9ce1-89570c691138-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:53:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] Lock "cinder-4e99eb50-1151-4618-9ce1-89570c691138-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:53:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] Acquiring lock "cinder-quobyte-4e99eb50-1151-4618-9ce1-89570c691138" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:53:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] Lock "cinder-quobyte-4e99eb50-1151-4618-9ce1-89570c691138" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:53:39 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f553f5-408f-47d8-93ca-8df012b6ffd5]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:53:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4e99eb50-1151-4618-9ce1-89570c691138 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:39 devstack sudo[92799]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.info" returned: 0 in 1.039s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:39 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 23:53:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:40 devstack sudo[92803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.info Jul 03 23:53:40 devstack sudo[92803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:40 devstack sudo[92802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4e99eb50-1151-4618-9ce1-89570c691138 Jul 03 23:53:40 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:41 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4e99eb50-1151-4618-9ce1-89570c691138" returned: 0 in 1.302s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4e99eb50-1151-4618-9ce1-89570c691138 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:41 devstack sudo[92813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4e99eb50-1151-4618-9ce1-89570c691138 Jul 03 23:53:41 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:41 devstack sudo[92803]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.info" returned: 0 in 1.321s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.447s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:53:41 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-22cf0903-40cd-41d4-9eef-8ac9ef022dc2 tempest-GroupSnapshotsTest-2036801966 None] group_snapshot 7e44387d-3bac-4d13-b453-1c4e34610f2e: created successfully Jul 03 23:53:41 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4e99eb50-1151-4618-9ce1-89570c691138" returned: 0 in 0.816s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] Lock "cinder-quobyte-4e99eb50-1151-4618-9ce1-89570c691138" released by "delete_volume" :: held 2.186s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:53:42 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] Created reservations ['7b9ff635-ae94-45a3-aced-5936d733aa5c', 'a28c59b0-ac11-4a02-a5cc-09845e7e7565', '50667d5c-4cad-41a4-8870-66ec2da9b128', '743d227b-ca45-4f6b-a751-4ad19166c689'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:53:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:53:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:53:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:53:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:53:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:53:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:42 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:53:42 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:42 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.719s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:42 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:53:42 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] Deleted volume successfully. Jul 03 23:53:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-20e4c5da-a862-4378-8668-31c3fe5cff14 tempest-ServerActionsTestOtherA-839083992 None] Lock "cinder-4e99eb50-1151-4618-9ce1-89570c691138-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "cinder-quobyte-e538b740-a8e0-4d3c-bf57-5d6842b52456-81f5e444-88c0-4f8d-b72f-66448a499233" by "_create_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-e538b740-a8e0-4d3c-bf57-5d6842b52456-81f5e444-88c0-4f8d-b72f-66448a499233" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Creating volume 81f5e444-88c0-4f8d-b72f-66448a499233 from snapshot e538b740-a8e0-4d3c-bf57-5d6842b52456 {{(pid=86676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "cinder-quobyte-81f5e444-88c0-4f8d-b72f-66448a499233" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-81f5e444-88c0-4f8d-b72f-66448a499233" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] snapshot: e538b740-a8e0-4d3c-bf57-5d6842b52456, volume: 81f5e444-88c0-4f8d-b72f-66448a499233, {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f4b253-ac37-4198-9972-644e11cfb26f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:53:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:44 devstack sudo[92820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456 Jul 03 23:53:44 devstack sudo[92820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:45 devstack sudo[92820]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456" returned: 0 in 1.137s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22b12422-2292-4d87-a87e-36312b66dddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:53:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 23:53:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 23:53:45 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ba3713-1978-4643-ad85-f25bbf022d4e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:53:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:45 devstack sudo[92838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc Jul 03 23:53:45 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:46 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc" returned: 0 in 1.456s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:46 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Path /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81f5e444-88c0-4f8d-b72f-66448a499233 not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 23:53:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81f5e444-88c0-4f8d-b72f-66448a499233 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:46 devstack sudo[92870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81f5e444-88c0-4f8d-b72f-66448a499233 Jul 03 23:53:46 devstack sudo[92870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:52 devstack sudo[92870]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81f5e444-88c0-4f8d-b72f-66448a499233" returned: 0 in 6.187s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:52 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5455d5-d524-4752-99ba-06c7831796cb]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:53:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:52 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc Jul 03 23:53:52 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:53 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=9 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:53:53 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=10,cinder:SELECT=12,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:53:53 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc" returned: 0 in 1.113s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:53 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81f5e444-88c0-4f8d-b72f-66448a499233 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 23:53:53 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Converted 1024.00 MB image at 165.47 MB/s Jul 03 23:53:53 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81f5e444-88c0-4f8d-b72f-66448a499233 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 23:53:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81f5e444-88c0-4f8d-b72f-66448a499233 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:53 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81f5e444-88c0-4f8d-b72f-66448a499233 Jul 03 23:53:53 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:54 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81f5e444-88c0-4f8d-b72f-66448a499233" returned: 0 in 0.954s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-81f5e444-88c0-4f8d-b72f-66448a499233" released by "_copy_volume_from_snapshot" :: held 10.981s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:53:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-e538b740-a8e0-4d3c-bf57-5d6842b52456-81f5e444-88c0-4f8d-b72f-66448a499233" released by "_create_volume_from_snapshot" :: held 11.029s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:53:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.051s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:53:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a02c4fbe-fae1-487a-acde-7f1e92b784b2 tempest-GroupSnapshotsTest-2036801966 None] Create group from source-snapshot-7e44387d-3bac-4d13-b453-1c4e34610f2e completed successfully. Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Flow 'volume_create_manager' (47da7829-af67-4f81-a1e3-094912ac5112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55fe2cd-6bef-42d4-81f1-045ecda56e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55fe2cd-6bef-42d4-81f1-045ecda56e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1665860400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf80776-ce55-438b-8a65-fa8653b1ef80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5183735a9304ac0b8df93df53f76a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:56Z,use_quota=True,user_id='b7893cafa0fe41679e053d313d3ce948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54457f46-da1d-4396-a7a5-8f8ac4470606),volume_type_id=54457f46-da1d-4396-a7a5-8f8ac4470606)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bdd2f1f-e996-4e10-b9d4-89f68ee30446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bdd2f1f-e996-4e10-b9d4-89f68ee30446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95d3013-1950-47b7-a9f9-ad8a252538dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95d3013-1950-47b7-a9f9-ad8a252538dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf80776-ce55-438b-8a65-fa8653b1ef80', 'volume_name': 'volume-ebf80776-ce55-438b-8a65-fa8653b1ef80', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fade073-97b6-4638-a0d7-1b315f7a351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fade073-97b6-4638-a0d7-1b315f7a351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf04b61-2866-4d78-abe5-127a0f093952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:53:55 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Volume ebf80776-ce55-438b-8a65-fa8653b1ef80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf80776-ce55-438b-8a65-fa8653b1ef80', 'volume_size': 1} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1665860400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf80776-ce55-438b-8a65-fa8653b1ef80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5183735a9304ac0b8df93df53f76a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:56Z,use_quota=True,user_id='b7893cafa0fe41679e053d313d3ce948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54457f46-da1d-4396-a7a5-8f8ac4470606),volume_type_id=54457f46-da1d-4396-a7a5-8f8ac4470606)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Creating volume ebf80776-ce55-438b-8a65-fa8653b1ef80 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:53:55 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:53:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ebf80776-ce55-438b-8a65-fa8653b1ef80 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:55 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ebf80776-ce55-438b-8a65-fa8653b1ef80 1073741824 Jul 03 23:53:55 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:56 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ebf80776-ce55-438b-8a65-fa8653b1ef80 1073741824" returned: 0 in 0.918s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ebf80776-ce55-438b-8a65-fa8653b1ef80 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:56 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ebf80776-ce55-438b-8a65-fa8653b1ef80 Jul 03 23:53:56 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "cinder-quobyte-81f5e444-88c0-4f8d-b72f-66448a499233" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:53:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-81f5e444-88c0-4f8d-b72f-66448a499233" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:53:56 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b744bd5f-5d33-426d-938b-0145fbf06dd7]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:53:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81f5e444-88c0-4f8d-b72f-66448a499233 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:56 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81f5e444-88c0-4f8d-b72f-66448a499233 Jul 03 23:53:56 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:57 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ebf80776-ce55-438b-8a65-fa8653b1ef80" returned: 0 in 0.948s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:53:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:53:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf04b61-2866-4d78-abe5-127a0f093952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf80776-ce55-438b-8a65-fa8653b1ef80', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:53:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58f3bba-eaac-4a86-9166-afcd6b72163c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:53:57 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Volume volume-ebf80776-ce55-438b-8a65-fa8653b1ef80 (ebf80776-ce55-438b-8a65-fa8653b1ef80): created successfully Jul 03 23:53:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58f3bba-eaac-4a86-9166-afcd6b72163c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:53:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Flow 'volume_create_manager' (47da7829-af67-4f81-a1e3-094912ac5112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:53:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9c0c03c1-d934-46e5-b6ba-48ecc0a2890d tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Created volume successfully. Jul 03 23:53:57 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81f5e444-88c0-4f8d-b72f-66448a499233" returned: 0 in 1.112s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81f5e444-88c0-4f8d-b72f-66448a499233 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:57 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81f5e444-88c0-4f8d-b72f-66448a499233 Jul 03 23:53:57 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:57 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:53:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Flow 'volume_create_manager' (450f4cf1-b4bf-4fd6-b3de-dd908ca96bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:53:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cfd6af-add4-4385-b4ef-caf2bb6e9528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cfd6af-add4-4385-b4ef-caf2bb6e9528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1829440678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28038fd-59c0-43a0-96a1-b6ac4e5c18ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0c437529e34685851880ac7930d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:58Z,use_quota=True,user_id='8486ec1c00f845659dd33823ee41fb49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a158a52c-3364-4eae-9a0a-60105079ac95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a158a52c-3364-4eae-9a0a-60105079ac95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17adfd7-ea24-4402-9d8e-cc0f49d1ce4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17adfd7-ea24-4402-9d8e-cc0f49d1ce4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a28038fd-59c0-43a0-96a1-b6ac4e5c18ca', 'volume_name': 'volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0282b7-c1a2-4b85-82b8-599915dca48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0282b7-c1a2-4b85-82b8-599915dca48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb726f44-fa97-48d1-a7d6-534e379aaa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:53:58 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Volume a28038fd-59c0-43a0-96a1-b6ac4e5c18ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca', 'volume_size': 1} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1829440678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28038fd-59c0-43a0-96a1-b6ac4e5c18ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0c437529e34685851880ac7930d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:58Z,use_quota=True,user_id='8486ec1c00f845659dd33823ee41fb49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Creating volume a28038fd-59c0-43a0-96a1-b6ac4e5c18ca {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:53:58 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:58 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca 1073741824 Jul 03 23:53:58 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:58 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81f5e444-88c0-4f8d-b72f-66448a499233" returned: 0 in 0.909s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-81f5e444-88c0-4f8d-b72f-66448a499233" released by "delete_volume" :: held 2.085s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] Created reservations ['cbe5775d-1d71-41c9-b3cb-4a2026d225ff'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:53:58 devstack cinder-volume[86676]: WARNING cinder.quota [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-483557865 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-483557865, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:53:58 devstack cinder-volume[86676]: WARNING cinder.quota [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-483557865 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-483557865, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:53:58 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] Created reservations ['0a556c61-2e4a-416a-a4fd-e5f3c7a2b5f5', 'f7233711-b493-43d0-8a65-0af5e8d31066', 'd95aa6a7-a410-4422-838f-9b02db2e80fe', '5a7076fd-5c87-46d5-87fb-3fb3bd4ee355'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:53:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:53:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:53:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:53:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:53:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:53:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:59 devstack sudo[92946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:53:59 devstack sudo[92946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:59 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Jul 03 23:53:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca 1073741824" returned: 0 in 1.188s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:53:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:59 devstack sudo[92948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca Jul 03 23:53:59 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:53:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0a2fd412-d99b-4d44-9b70-789a7fded121 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:53:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0a2fd412-d99b-4d44-9b70-789a7fded121 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:53:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0a2fd412-d99b-4d44-9b70-789a7fded121 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:53:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0a2fd412-d99b-4d44-9b70-789a7fded121 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:53:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0a2fd412-d99b-4d44-9b70-789a7fded121 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:53:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0a2fd412-d99b-4d44-9b70-789a7fded121 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:53:59 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:53:59 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:00 devstack sudo[92946]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.964s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:54:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-75bec4f7-c791-4f2a-a877-421c502ab83d tempest-GroupSnapshotsTest-2036801966 None] Delete group completed successfully. Jul 03 23:54:00 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] group_snapshot 7e44387d-3bac-4d13-b453-1c4e34610f2e: deleting Jul 03 23:54:00 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0a2fd412-d99b-4d44-9b70-789a7fded121 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.845s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-0a2fd412-d99b-4d44-9b70-789a7fded121 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca" returned: 0 in 1.060s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] <== create_volume: return (2365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.368s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0a2fd412-d99b-4d44-9b70-789a7fded121 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Retype volume completed successfully. Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] group_snapshot 7e44387d-3bac-4d13-b453-1c4e34610f2e: deleting {{(pid=86676) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb726f44-fa97-48d1-a7d6-534e379aaa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a0db25a-60ff-45f7-a911-343a101af0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:00 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Volume volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca (a28038fd-59c0-43a0-96a1-b6ac4e5c18ca): created successfully Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a0db25a-60ff-45f7-a911-343a101af0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Flow 'volume_create_manager' (450f4cf1-b4bf-4fd6-b3de-dd908ca96bae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "cinder-quobyte-22b12422-2292-4d87-a87e-36312b66dddc" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b4212683-8573-41d9-9399-cd609769d889 tempest-AttachVolumeTestJSON-2023149251 None] Created volume successfully. Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-22b12422-2292-4d87-a87e-36312b66dddc" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "cinder-quobyte-e538b740-a8e0-4d3c-bf57-5d6842b52456" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-e538b740-a8e0-4d3c-bf57-5d6842b52456" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] Deleting offline snapshot e538b740-a8e0-4d3c-bf57-5d6842b52456 of volume 22b12422-2292-4d87-a87e-36312b66dddc {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] snapshot_file for this snap is: volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6cdb67-fe9f-4a10-8c4b-7121f02b2c1e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:00 devstack sudo[92962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456 Jul 03 23:54:00 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Acquiring lock "cinder-ebf80776-ce55-438b-8a65-fa8653b1ef80-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Lock "cinder-ebf80776-ce55-438b-8a65-fa8653b1ef80-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Acquiring lock "cinder-quobyte-ebf80776-ce55-438b-8a65-fa8653b1ef80" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Lock "cinder-quobyte-ebf80776-ce55-438b-8a65-fa8653b1ef80" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:00 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[12385776-2fea-48cf-ae20-b9cad0ff9032]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ebf80776-ce55-438b-8a65-fa8653b1ef80 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:01 devstack sudo[92964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ebf80776-ce55-438b-8a65-fa8653b1ef80 Jul 03 23:54:01 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:01 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456" returned: 0 in 0.972s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22b12422-2292-4d87-a87e-36312b66dddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:54:01 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb265f0-afcc-4fde-af5a-4f6a16b8e8ae]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:01 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc Jul 03 23:54:01 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:01 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ebf80776-ce55-438b-8a65-fa8653b1ef80" returned: 0 in 0.927s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ebf80776-ce55-438b-8a65-fa8653b1ef80 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:01 devstack sudo[92978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ebf80776-ce55-438b-8a65-fa8653b1ef80 Jul 03 23:54:01 devstack sudo[92978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:02 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc" returned: 0 in 0.890s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:02 devstack sudo[92984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456 Jul 03 23:54:02 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:02 devstack sudo[92978]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ebf80776-ce55-438b-8a65-fa8653b1ef80" returned: 0 in 0.825s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Lock "cinder-quobyte-ebf80776-ce55-438b-8a65-fa8653b1ef80" released by "delete_volume" :: held 1.812s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:02 devstack cinder-volume[86676]: WARNING cinder.quota [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:54:02 devstack cinder-volume[86676]: WARNING cinder.quota [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:54:02 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Created reservations ['eb8ee39d-2da3-4d4d-82dd-a36cee18d6d5', 'd2f66c03-8ce1-4871-a6f8-cd42b89bae90', '294b1387-34b2-4c22-906a-7cd236ab6107', 'ce0b5600-602a-4bcd-ad13-eeec7cd917fb'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:54:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:54:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:54:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:02 devstack sudo[92986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:54:02 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:03 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456" returned: 0 in 1.020s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:03 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456 Jul 03 23:54:03 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:04 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.044s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:04 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:54:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Deleted volume successfully. Jul 03 23:54:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6cd8a5d3-4e46-4467-b41f-dc62c3ecc895 tempest-VolumeRetypeWithoutMigrationTest-2113514183 None] Lock "cinder-ebf80776-ce55-438b-8a65-fa8653b1ef80-delete_volume" released by "delete_volume" :: held 3.148s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-1bbfb35a-c925-4855-8ff0-bbf5c2eec2e5 req-fb93aa64-7049-413c-8725-4136187f2ac7 tempest-AttachVolumeTestJSON-2023149251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-1bbfb35a-c925-4855-8ff0-bbf5c2eec2e5 req-fb93aa64-7049-413c-8725-4136187f2ac7 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:04 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[01281c00-4d4b-4ea6-8e43-aa07ed2e2666]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-1bbfb35a-c925-4855-8ff0-bbf5c2eec2e5 req-fb93aa64-7049-413c-8725-4136187f2ac7 tempest-AttachVolumeTestJSON-2023149251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:04 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc.e538b740-a8e0-4d3c-bf57-5d6842b52456" returned: 0 in 0.895s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-e538b740-a8e0-4d3c-bf57-5d6842b52456" released by "_delete_snapshot" :: held 3.960s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-22b12422-2292-4d87-a87e-36312b66dddc" released by "delete_snapshot" :: held 4.032s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:04 devstack sudo[93004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca Jul 03 23:54:04 devstack sudo[93004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:04 devstack cinder-volume[86676]: WARNING cinder.quota [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-483557865 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-483557865, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:54:04 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] Created reservations ['9da2d0b2-9107-4986-8bd5-a1a4c76bf0ee', '1f3540e8-447f-4987-9c89-45d65f748682', '0a52196a-9127-4e0d-a030-8b41436d8288', '219a96a6-1a63-4677-b1f0-233fd04523d6'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:54:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-bccff791-7b0e-4f4f-9b00-38373ec11847 tempest-GroupSnapshotsTest-2036801966 None] group_snapshot 7e44387d-3bac-4d13-b453-1c4e34610f2e: deleted successfully Jul 03 23:54:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9ff703e8-8589-4214-b5e7-61286438ffbc tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "cinder-quobyte-22b12422-2292-4d87-a87e-36312b66dddc" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9ff703e8-8589-4214-b5e7-61286438ffbc tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-22b12422-2292-4d87-a87e-36312b66dddc" acquired by "delete_volume" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:05 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4b999b-bcba-45f6-a979-15b08c791e15]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ff703e8-8589-4214-b5e7-61286438ffbc tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:05 devstack sudo[93009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc Jul 03 23:54:05 devstack sudo[93009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:05 devstack sudo[93004]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-1bbfb35a-c925-4855-8ff0-bbf5c2eec2e5 req-fb93aa64-7049-413c-8725-4136187f2ac7 tempest-AttachVolumeTestJSON-2023149251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca" returned: 0 in 1.290s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-1bbfb35a-c925-4855-8ff0-bbf5c2eec2e5 req-fb93aa64-7049-413c-8725-4136187f2ac7 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.319s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-1bbfb35a-c925-4855-8ff0-bbf5c2eec2e5 req-fb93aa64-7049-413c-8725-4136187f2ac7 tempest-AttachVolumeTestJSON-2023149251 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '146c2bcd-d261-4a49-aceb-6120d00c719b', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 03 23:54:05 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-1bbfb35a-c925-4855-8ff0-bbf5c2eec2e5 req-fb93aa64-7049-413c-8725-4136187f2ac7 tempest-AttachVolumeTestJSON-2023149251 None] attachment_update completed successfully. Jul 03 23:54:06 devstack sudo[93009]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ff703e8-8589-4214-b5e7-61286438ffbc tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc" returned: 0 in 1.045s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ff703e8-8589-4214-b5e7-61286438ffbc tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:06 devstack sudo[93036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc Jul 03 23:54:06 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:07 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ff703e8-8589-4214-b5e7-61286438ffbc tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22b12422-2292-4d87-a87e-36312b66dddc" returned: 0 in 0.853s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9ff703e8-8589-4214-b5e7-61286438ffbc tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-22b12422-2292-4d87-a87e-36312b66dddc" released by "delete_volume" :: held 2.029s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:07 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-9ff703e8-8589-4214-b5e7-61286438ffbc tempest-GroupSnapshotsTest-2036801966 None] Created reservations ['cb4485e6-30c7-4d77-853b-cd10b2799afe'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:54:07 devstack cinder-volume[86676]: WARNING cinder.db.sqlalchemy.api [None req-9ff703e8-8589-4214-b5e7-61286438ffbc tempest-GroupSnapshotsTest-2036801966 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-483557865'] Jul 03 23:54:07 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-9ff703e8-8589-4214-b5e7-61286438ffbc tempest-GroupSnapshotsTest-2036801966 None] Created reservations ['0ecdb2f7-fedd-45fd-bc03-145bd6fc3796', '001b77e5-0804-4b57-9972-e4b5b6f74ca2', '9e50db6a-253c-4f34-b43f-2b8fea08c41e', 'aab94b25-423c-4136-9c9d-69a3c34ce51e'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:54:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ff703e8-8589-4214-b5e7-61286438ffbc tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ff703e8-8589-4214-b5e7-61286438ffbc tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9ff703e8-8589-4214-b5e7-61286438ffbc tempest-GroupSnapshotsTest-2036801966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:54:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9ff703e8-8589-4214-b5e7-61286438ffbc tempest-GroupSnapshotsTest-2036801966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:54:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ff703e8-8589-4214-b5e7-61286438ffbc tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ff703e8-8589-4214-b5e7-61286438ffbc tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:07 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:54:07 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:08 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8701a4cc-e2ed-4ff8-812d-ab419e233f3f tempest-GroupSnapshotsTest-2036801966 None] Group tempest-GroupSnapshotsTest-Group-27368901: creating Jul 03 23:54:08 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8701a4cc-e2ed-4ff8-812d-ab419e233f3f tempest-GroupSnapshotsTest-2036801966 None] Group tempest-GroupSnapshotsTest-Group-27368901: created successfully Jul 03 23:54:08 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8701a4cc-e2ed-4ff8-812d-ab419e233f3f tempest-GroupSnapshotsTest-2036801966 None] Create group completed successfully. Jul 03 23:54:08 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ff703e8-8589-4214-b5e7-61286438ffbc tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.147s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:08 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9ff703e8-8589-4214-b5e7-61286438ffbc tempest-GroupSnapshotsTest-2036801966 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:54:08 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9ff703e8-8589-4214-b5e7-61286438ffbc tempest-GroupSnapshotsTest-2036801966 None] Delete group completed successfully. Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Flow 'volume_create_manager' (11feb92f-b0cd-4851-9c78-62583555092f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151f5cc5-da19-4fad-adaf-f345aeb0094b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151f5cc5-da19-4fad-adaf-f345aeb0094b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-939376756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24b346ba-41ba-4921-ba65-3be1d29c4ca6,host='devstack@QuobyteHD#QuobyteHD',id=5d5bda7b-97d5-4f07-a56f-c25f173f2e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c89ac31e0e49d182ffeb088372ee9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:11Z,use_quota=True,user_id='4a2f90aa79554115b2deb87d8cdb3712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e272648e-e0ad-4ad4-af35-9dc129244810),volume_type_id=e272648e-e0ad-4ad4-af35-9dc129244810)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd61302-22bc-4891-bede-82127a39167d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd61302-22bc-4891-bede-82127a39167d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a6e6bd-fdb9-4694-96a4-6c8c93a92b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a6e6bd-fdb9-4694-96a4-6c8c93a92b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d5bda7b-97d5-4f07-a56f-c25f173f2e6e', 'volume_name': 'volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9183703b-935a-4096-bcee-7ca0a70a9863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9183703b-935a-4096-bcee-7ca0a70a9863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb77a1d-5857-4ec9-b62e-af84a49858da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:10 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Volume 5d5bda7b-97d5-4f07-a56f-c25f173f2e6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e', 'volume_size': 1} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=24b346ba-41ba-4921-ba65-3be1d29c4ca6,created_at=2026-07-03T21:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-939376756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24b346ba-41ba-4921-ba65-3be1d29c4ca6,host='devstack@QuobyteHD#QuobyteHD',id=5d5bda7b-97d5-4f07-a56f-c25f173f2e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c89ac31e0e49d182ffeb088372ee9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:11Z,use_quota=True,user_id='4a2f90aa79554115b2deb87d8cdb3712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e272648e-e0ad-4ad4-af35-9dc129244810),volume_type_id=e272648e-e0ad-4ad4-af35-9dc129244810)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Creating volume 5d5bda7b-97d5-4f07-a56f-c25f173f2e6e {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:54:10 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:54:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:10 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e 1073741824 Jul 03 23:54:10 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:11 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:54:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Flow 'volume_create_manager' (10fe9031-3a5d-4e5e-994a-54f215b9e5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:54:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6865017-92e1-42ee-a0a9-260d22eb5227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6865017-92e1-42ee-a0a9-260d22eb5227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-442106937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0644ac-1819-4d72-828e-6f06c528d0d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0c437529e34685851880ac7930d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:12Z,use_quota=True,user_id='8486ec1c00f845659dd33823ee41fb49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f9a2bb-52e7-417f-957a-4bb3cc6c84a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f9a2bb-52e7-417f-957a-4bb3cc6c84a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c2b61a-adbf-45d3-9410-6e13f77ff6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c2b61a-adbf-45d3-9410-6e13f77ff6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee0644ac-1819-4d72-828e-6f06c528d0d8', 'volume_name': 'volume-ee0644ac-1819-4d72-828e-6f06c528d0d8', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e3d533-70c2-4fb1-bce2-abe142b4070d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e3d533-70c2-4fb1-bce2-abe142b4070d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab454795-3f0e-4c6d-b355-63b4cfb273f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:11 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Volume ee0644ac-1819-4d72-828e-6f06c528d0d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee0644ac-1819-4d72-828e-6f06c528d0d8', 'volume_size': 1} Jul 03 23:54:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e 1073741824" returned: 0 in 1.384s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:12 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:12 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e Jul 03 23:54:12 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:12 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e" returned: 0 in 0.775s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] <== create_volume: return (2217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:54:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.999s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-442106937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0644ac-1819-4d72-828e-6f06c528d0d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0c437529e34685851880ac7930d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:12Z,use_quota=True,user_id='8486ec1c00f845659dd33823ee41fb49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:54:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Creating volume ee0644ac-1819-4d72-828e-6f06c528d0d8 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:54:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:54:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:54:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:54:12 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:54:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ee0644ac-1819-4d72-828e-6f06c528d0d8 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:13 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ee0644ac-1819-4d72-828e-6f06c528d0d8 1073741824 Jul 03 23:54:13 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb77a1d-5857-4ec9-b62e-af84a49858da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f77675-dc65-4285-a7a9-ddccd15bb0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:13 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Volume volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e (5d5bda7b-97d5-4f07-a56f-c25f173f2e6e): created successfully Jul 03 23:54:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f77675-dc65-4285-a7a9-ddccd15bb0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Flow 'volume_create_manager' (11feb92f-b0cd-4851-9c78-62583555092f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:54:13 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b9c4c3a9-3f4c-464d-a8a9-7e5ea4dd15ea tempest-GroupSnapshotsTest-2036801966 None] Created volume successfully. Jul 03 23:54:14 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ee0644ac-1819-4d72-828e-6f06c528d0d8 1073741824" returned: 0 in 1.180s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ee0644ac-1819-4d72-828e-6f06c528d0d8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:14 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ee0644ac-1819-4d72-828e-6f06c528d0d8 Jul 03 23:54:14 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:15 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ee0644ac-1819-4d72-828e-6f06c528d0d8" returned: 0 in 0.912s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.163s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab454795-3f0e-4c6d-b355-63b4cfb273f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0644ac-1819-4d72-828e-6f06c528d0d8', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3844b9c-b204-49bd-aee8-efac850f830f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:15 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Volume volume-ee0644ac-1819-4d72-828e-6f06c528d0d8 (ee0644ac-1819-4d72-828e-6f06c528d0d8): created successfully Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3844b9c-b204-49bd-aee8-efac850f830f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Flow 'volume_create_manager' (10fe9031-3a5d-4e5e-994a-54f215b9e5f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Flow 'volume_create_manager' (71518c00-325c-4917-9c96-046cca7aeee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9619d8f4-15c0-43b0-b8c8-a6646b18b135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:15 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-39f51c65-fa5e-4a66-aa34-148de43debd5 tempest-AttachVolumeTestJSON-2023149251 None] Created volume successfully. Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9619d8f4-15c0-43b0-b8c8-a6646b18b135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-122728740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24b346ba-41ba-4921-ba65-3be1d29c4ca6,host='devstack@QuobyteHD#QuobyteHD',id=390858f6-06e9-4ce8-91d3-a65d32493710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c89ac31e0e49d182ffeb088372ee9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:15Z,use_quota=True,user_id='4a2f90aa79554115b2deb87d8cdb3712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e272648e-e0ad-4ad4-af35-9dc129244810),volume_type_id=e272648e-e0ad-4ad4-af35-9dc129244810)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f63283-65db-47f0-83ee-10a631e735e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f63283-65db-47f0-83ee-10a631e735e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858ec222-6f6f-43e9-840c-cd9013fdbfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858ec222-6f6f-43e9-840c-cd9013fdbfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '390858f6-06e9-4ce8-91d3-a65d32493710', 'volume_name': 'volume-390858f6-06e9-4ce8-91d3-a65d32493710', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4375f440-0807-4df2-ad0e-6d23dac09bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4375f440-0807-4df2-ad0e-6d23dac09bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89bf80d-94f7-4cfd-9fd5-0c12934dca0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:15 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Volume 390858f6-06e9-4ce8-91d3-a65d32493710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-390858f6-06e9-4ce8-91d3-a65d32493710', 'volume_size': 1} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=24b346ba-41ba-4921-ba65-3be1d29c4ca6,created_at=2026-07-03T21:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-122728740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24b346ba-41ba-4921-ba65-3be1d29c4ca6,host='devstack@QuobyteHD#QuobyteHD',id=390858f6-06e9-4ce8-91d3-a65d32493710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c89ac31e0e49d182ffeb088372ee9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:15Z,use_quota=True,user_id='4a2f90aa79554115b2deb87d8cdb3712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e272648e-e0ad-4ad4-af35-9dc129244810),volume_type_id=e272648e-e0ad-4ad4-af35-9dc129244810)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Creating volume 390858f6-06e9-4ce8-91d3-a65d32493710 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:54:15 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:54:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:15 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710 1073741824 Jul 03 23:54:15 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:16 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710 1073741824" returned: 0 in 1.050s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:16 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710 Jul 03 23:54:16 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:17 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710" returned: 0 in 0.744s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:54:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89bf80d-94f7-4cfd-9fd5-0c12934dca0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-390858f6-06e9-4ce8-91d3-a65d32493710', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1f6b43-ba0e-49a2-acdb-7e96cf10982e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:17 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Volume volume-390858f6-06e9-4ce8-91d3-a65d32493710 (390858f6-06e9-4ce8-91d3-a65d32493710): created successfully Jul 03 23:54:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1f6b43-ba0e-49a2-acdb-7e96cf10982e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Flow 'volume_create_manager' (71518c00-325c-4917-9c96-046cca7aeee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:54:17 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d928631a-4c33-4b05-9017-3eed0bbdf6cd tempest-GroupSnapshotsTest-2036801966 None] Created volume successfully. Jul 03 23:54:17 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f486455e-e402-45b7-b468-bd7e9c869827 tempest-GroupSnapshotsTest-2036801966 None] Update group completed successfully. Jul 03 23:54:19 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b61ed0a3-9dff-4da2-9f14-043be654d394 tempest-GroupSnapshotsTest-2036801966 None] Update group completed successfully. Jul 03 23:54:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-ccbb82cf-9446-4f8f-8e15-27911c0ebcfa req-cbd6ae73-8b6b-4d4f-9e73-6b9ffedc6544 tempest-AttachVolumeTestJSON-2023149251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-ccbb82cf-9446-4f8f-8e15-27911c0ebcfa req-cbd6ae73-8b6b-4d4f-9e73-6b9ffedc6544 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:19 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a134d3ae-90eb-4dcd-a0f8-d7ea6dac0243]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-ccbb82cf-9446-4f8f-8e15-27911c0ebcfa req-cbd6ae73-8b6b-4d4f-9e73-6b9ffedc6544 tempest-AttachVolumeTestJSON-2023149251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ee0644ac-1819-4d72-828e-6f06c528d0d8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:19 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ee0644ac-1819-4d72-828e-6f06c528d0d8 Jul 03 23:54:19 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8fc36e77-80f1-40fa-9b41-98c145b95b0a tempest-GroupSnapshotsTest-2036801966 None] Update group completed successfully. Jul 03 23:54:20 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-ccbb82cf-9446-4f8f-8e15-27911c0ebcfa req-cbd6ae73-8b6b-4d4f-9e73-6b9ffedc6544 tempest-AttachVolumeTestJSON-2023149251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ee0644ac-1819-4d72-828e-6f06c528d0d8" returned: 0 in 0.947s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-ccbb82cf-9446-4f8f-8e15-27911c0ebcfa req-cbd6ae73-8b6b-4d4f-9e73-6b9ffedc6544 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-ccbb82cf-9446-4f8f-8e15-27911c0ebcfa req-cbd6ae73-8b6b-4d4f-9e73-6b9ffedc6544 tempest-AttachVolumeTestJSON-2023149251 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-ee0644ac-1819-4d72-828e-6f06c528d0d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e69bb2d-76df-46e2-b709-e5da2f7b43dc', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 03 23:54:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-ccbb82cf-9446-4f8f-8e15-27911c0ebcfa req-cbd6ae73-8b6b-4d4f-9e73-6b9ffedc6544 tempest-AttachVolumeTestJSON-2023149251 None] attachment_update completed successfully. Jul 03 23:54:21 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4f9ab781-234f-4d9a-a987-edd5884d05f5 tempest-GroupSnapshotsTest-2036801966 None] Update group completed successfully. Jul 03 23:54:23 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] GroupSnapshot f30a29b0-6038-49a0-82a0-984573eb8d00: creating. Jul 03 23:54:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Group snapshot f30a29b0-6038-49a0-82a0-984573eb8d00: creating. {{(pid=86676) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jul 03 23:54:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Creating offline snapshot aee8dc10-381d-4482-9070-e031ae372773 of volume 390858f6-06e9-4ce8-91d3-a65d32493710 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 23:54:23 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d883ec4-5a4f-4764-9ec8-6fbb830554d0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:23 devstack sudo[93474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710 Jul 03 23:54:23 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:24 devstack sudo[93474]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710" returned: 0 in 0.803s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:24 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773 1G Jul 03 23:54:24 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:25 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773 1G" returned: 0 in 1.003s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-390858f6-06e9-4ce8-91d3-a65d32493710 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:25 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-390858f6-06e9-4ce8-91d3-a65d32493710 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773 Jul 03 23:54:25 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:26 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-390858f6-06e9-4ce8-91d3-a65d32493710 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773" returned: 0 in 0.957s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:26 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 23:54:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:26 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773 Jul 03 23:54:26 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:27 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773" returned: 0 in 1.103s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:27 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.info Jul 03 23:54:27 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-ea6165f7-acca-4578-9e06-5dbe3ed94046 req-021020af-b004-48a8-b129-a50ceeb57d77 tempest-AttachVolumeTestJSON-2023149251 None] Terminate volume connection completed successfully. Jul 03 23:54:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-ea6165f7-acca-4578-9e06-5dbe3ed94046 req-021020af-b004-48a8-b129-a50ceeb57d77 tempest-AttachVolumeTestJSON-2023149251 None] Deleting attachment 146c2bcd-d261-4a49-aceb-6120d00c719b. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 03 23:54:28 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.info" returned: 0 in 0.988s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:28 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 23:54:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:28 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.info Jul 03 23:54:28 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:29 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.info" returned: 0 in 1.010s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.014s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Creating offline snapshot c589ede5-6fb6-4602-b167-5f9226562277 of volume 5d5bda7b-97d5-4f07-a56f-c25f173f2e6e {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 23:54:29 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac0d80b-2d2f-448d-a41c-8bda656e74d9]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:29 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e Jul 03 23:54:29 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:30 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e" returned: 0 in 0.968s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:30 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277 1G Jul 03 23:54:30 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:31 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277 1G" returned: 0 in 1.099s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:31 devstack sudo[93609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277 Jul 03 23:54:31 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:32 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-cfc635ac-dafd-4cb2-927f-852e82fd211b req-526e450f-fbda-47a3-b001-46305ce47845 tempest-AttachVolumeTestJSON-2023149251 None] Terminate volume connection completed successfully. Jul 03 23:54:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-cfc635ac-dafd-4cb2-927f-852e82fd211b req-526e450f-fbda-47a3-b001-46305ce47845 tempest-AttachVolumeTestJSON-2023149251 None] Deleting attachment 6e69bb2d-76df-46e2-b709-e5da2f7b43dc. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 03 23:54:32 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277" returned: 0 in 1.271s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:32 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 23:54:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:32 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277 Jul 03 23:54:32 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Flow 'volume_create_manager' (aab38857-f0a8-46f4-9fcd-d139b7074e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406a81bf-0d48-4fad-884f-e1e4c937677a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406a81bf-0d48-4fad-884f-e1e4c937677a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1280707788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5eb5e4f79424642a7431f8c04864474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:33Z,use_quota=True,user_id='1c3231e33fab46468bd0fcd5af911f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b890a13-9dab-441a-aa2d-eab2b4ead19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b890a13-9dab-441a-aa2d-eab2b4ead19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1bda77-eee9-4133-80a0-1f89333eaf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1bda77-eee9-4133-80a0-1f89333eaf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8ebffe6-1a85-42cc-8f1d-4f503a9f22d0', 'volume_name': 'volume-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad867ce-e115-47b6-8a2d-a1ac25ce16c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad867ce-e115-47b6-8a2d-a1ac25ce16c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb13a48-9eaa-481a-b450-341c37e24b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:33 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Volume d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0', 'volume_size': 1} Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:33 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:54:33 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:33 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277" returned: 0 in 0.960s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:33 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.info Jul 03 23:54:33 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:34 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.868s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:54:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:54:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 8 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 23:54:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 03 23:54:34 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.info" returned: 0 in 0.881s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:34 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 23:54:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:34 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.info Jul 03 23:54:34 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:35 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.info" returned: 0 in 0.784s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.127s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.163s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1280707788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5eb5e4f79424642a7431f8c04864474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:33Z,use_quota=True,user_id='1c3231e33fab46468bd0fcd5af911f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:54:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Creating volume d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:54:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:54:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:54:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:54:35 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:54:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:35 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0 1073741824 Jul 03 23:54:35 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:35 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9e0967af-e6c8-4d8e-b99f-30cff71d7031 tempest-GroupSnapshotsTest-2036801966 None] group_snapshot f30a29b0-6038-49a0-82a0-984573eb8d00: created successfully Jul 03 23:54:36 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0 1073741824" returned: 0 in 1.057s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:36 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] group_snapshot f30a29b0-6038-49a0-82a0-984573eb8d00: deleting Jul 03 23:54:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] group_snapshot f30a29b0-6038-49a0-82a0-984573eb8d00: deleting {{(pid=86676) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jul 03 23:54:36 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0 Jul 03 23:54:36 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "cinder-quobyte-390858f6-06e9-4ce8-91d3-a65d32493710" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-390858f6-06e9-4ce8-91d3-a65d32493710" acquired by "delete_snapshot" :: waited 0.069s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "cinder-quobyte-aee8dc10-381d-4482-9070-e031ae372773" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-aee8dc10-381d-4482-9070-e031ae372773" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Deleting offline snapshot aee8dc10-381d-4482-9070-e031ae372773 of volume 390858f6-06e9-4ce8-91d3-a65d32493710 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 23:54:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] snapshot_file for this snap is: volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 23:54:37 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[70769822-063c-4240-b289-d9da41d57540]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:37 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773 Jul 03 23:54:37 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:37 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0" returned: 0 in 1.185s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] <== create_volume: return (2367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:54:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.373s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb13a48-9eaa-481a-b450-341c37e24b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ec63ce-01bb-45a4-a8ae-96283f630ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:37 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Volume volume-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0 (d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0): created successfully Jul 03 23:54:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ec63ce-01bb-45a4-a8ae-96283f630ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Flow 'volume_create_manager' (aab38857-f0a8-46f4-9fcd-d139b7074e85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:54:37 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3dd5d386-2d6e-4d62-92c9-8b2966251174 tempest-VolumesListAdminTestJSON-428172504 None] Created volume successfully. Jul 03 23:54:38 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773" returned: 0 in 1.280s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-390858f6-06e9-4ce8-91d3-a65d32493710(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:54:38 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e120f921-3af8-406a-b0d8-bad05d51159b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:38 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710 Jul 03 23:54:38 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:40 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710" returned: 0 in 1.608s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:40 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773 Jul 03 23:54:40 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Flow 'volume_create_manager' (87fe004d-7f05-4ba6-83b8-d3d77163d662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4695a1-1d9d-4337-8caa-47bfaba20135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4695a1-1d9d-4337-8caa-47bfaba20135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-326893308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18eb9cd-6a22-498a-b2df-27ab29a4615f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5eb5e4f79424642a7431f8c04864474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:40Z,use_quota=True,user_id='1c3231e33fab46468bd0fcd5af911f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50edc447-8707-4374-9a2d-5e0d99cdeea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50edc447-8707-4374-9a2d-5e0d99cdeea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d424ecfd-fe58-4953-89ac-b72d0e5f8338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d424ecfd-fe58-4953-89ac-b72d0e5f8338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd18eb9cd-6a22-498a-b2df-27ab29a4615f', 'volume_name': 'volume-d18eb9cd-6a22-498a-b2df-27ab29a4615f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c41229-3c95-4aa9-baaa-a6f26c2f1e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c41229-3c95-4aa9-baaa-a6f26c2f1e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ea97fb-ee79-4c7a-8eec-89144a4336eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:40 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Volume d18eb9cd-6a22-498a-b2df-27ab29a4615f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d18eb9cd-6a22-498a-b2df-27ab29a4615f', 'volume_size': 1} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-326893308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18eb9cd-6a22-498a-b2df-27ab29a4615f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5eb5e4f79424642a7431f8c04864474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:40Z,use_quota=True,user_id='1c3231e33fab46468bd0fcd5af911f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Creating volume d18eb9cd-6a22-498a-b2df-27ab29a4615f {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:54:40 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:54:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d18eb9cd-6a22-498a-b2df-27ab29a4615f 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:40 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d18eb9cd-6a22-498a-b2df-27ab29a4615f 1073741824 Jul 03 23:54:40 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:41 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773" returned: 0 in 1.905s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:41 devstack sudo[93743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773 Jul 03 23:54:41 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:42 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d18eb9cd-6a22-498a-b2df-27ab29a4615f 1073741824" returned: 0 in 1.756s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d18eb9cd-6a22-498a-b2df-27ab29a4615f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:42 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d18eb9cd-6a22-498a-b2df-27ab29a4615f Jul 03 23:54:42 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:42 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710.aee8dc10-381d-4482-9070-e031ae372773" returned: 0 in 0.991s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-aee8dc10-381d-4482-9070-e031ae372773" released by "_delete_snapshot" :: held 5.945s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-390858f6-06e9-4ce8-91d3-a65d32493710" released by "delete_snapshot" :: held 6.016s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "cinder-quobyte-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "cinder-quobyte-c589ede5-6fb6-4602-b167-5f9226562277" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-c589ede5-6fb6-4602-b167-5f9226562277" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Deleting offline snapshot c589ede5-6fb6-4602-b167-5f9226562277 of volume 5d5bda7b-97d5-4f07-a56f-c25f173f2e6e {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 23:54:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] snapshot_file for this snap is: volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 23:54:43 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66fa747-3a2d-41b0-924a-4fd45f67fe3a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:43 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277 Jul 03 23:54:43 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:43 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d18eb9cd-6a22-498a-b2df-27ab29a4615f" returned: 0 in 0.875s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] <== create_volume: return (2726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:54:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.728s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ea97fb-ee79-4c7a-8eec-89144a4336eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d18eb9cd-6a22-498a-b2df-27ab29a4615f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6185456-e894-4f8d-81f4-afda4238ee88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:43 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Volume volume-d18eb9cd-6a22-498a-b2df-27ab29a4615f (d18eb9cd-6a22-498a-b2df-27ab29a4615f): created successfully Jul 03 23:54:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6185456-e894-4f8d-81f4-afda4238ee88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Flow 'volume_create_manager' (87fe004d-7f05-4ba6-83b8-d3d77163d662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:54:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-947f792e-d2d1-47f2-9a62-e882e8344dff tempest-VolumesListAdminTestJSON-428172504 None] Created volume successfully. Jul 03 23:54:43 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277" returned: 0 in 0.895s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:54:44 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[73416faa-feb2-48e9-8f07-06cd792bb0da]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:44 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e Jul 03 23:54:44 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:45 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] Acquiring lock "cinder-ee0644ac-1819-4d72-828e-6f06c528d0d8-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e" returned: 0 in 1.100s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:45 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277 Jul 03 23:54:45 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] Lock "cinder-ee0644ac-1819-4d72-828e-6f06c528d0d8-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Flow 'volume_create_manager' (c486747a-1a08-4333-b4b1-7243ff9317fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68ce2be-5cae-4cbf-8de7-6ec9f0ba4272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] Acquiring lock "cinder-quobyte-ee0644ac-1819-4d72-828e-6f06c528d0d8" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68ce2be-5cae-4cbf-8de7-6ec9f0ba4272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-836823710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb7269b-2276-47c7-8ee9-99cf6383b193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5eb5e4f79424642a7431f8c04864474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:45Z,use_quota=True,user_id='1c3231e33fab46468bd0fcd5af911f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b7e323-0ff8-4ca6-a6ed-e7e4b2ba2ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b7e323-0ff8-4ca6-a6ed-e7e4b2ba2ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd4e8a3-3c7c-4c02-97b3-28e747f96028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd4e8a3-3c7c-4c02-97b3-28e747f96028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fb7269b-2276-47c7-8ee9-99cf6383b193', 'volume_name': 'volume-0fb7269b-2276-47c7-8ee9-99cf6383b193', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625369a7-3a28-4b85-bd3a-9497715d0638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625369a7-3a28-4b85-bd3a-9497715d0638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dba9424-693f-4bee-9ff4-fa96724a0f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:45 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Volume 0fb7269b-2276-47c7-8ee9-99cf6383b193: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fb7269b-2276-47c7-8ee9-99cf6383b193', 'volume_size': 1} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-836823710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb7269b-2276-47c7-8ee9-99cf6383b193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5eb5e4f79424642a7431f8c04864474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:45Z,use_quota=True,user_id='1c3231e33fab46468bd0fcd5af911f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Creating volume 0fb7269b-2276-47c7-8ee9-99cf6383b193 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:54:45 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0fb7269b-2276-47c7-8ee9-99cf6383b193 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:45 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0fb7269b-2276-47c7-8ee9-99cf6383b193 1073741824 Jul 03 23:54:45 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] Lock "cinder-quobyte-ee0644ac-1819-4d72-828e-6f06c528d0d8" acquired by "delete_volume" :: waited 0.221s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3716a569-ed17-441b-940a-e6fc2c09deb3]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ee0644ac-1819-4d72-828e-6f06c528d0d8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:45 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ee0644ac-1819-4d72-828e-6f06c528d0d8 Jul 03 23:54:45 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:46 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277" returned: 0 in 1.330s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:46 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277 Jul 03 23:54:46 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:46 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0fb7269b-2276-47c7-8ee9-99cf6383b193 1073741824" returned: 0 in 1.323s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0fb7269b-2276-47c7-8ee9-99cf6383b193 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:46 devstack sudo[93822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0fb7269b-2276-47c7-8ee9-99cf6383b193 Jul 03 23:54:46 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:46 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ee0644ac-1819-4d72-828e-6f06c528d0d8" returned: 0 in 1.354s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ee0644ac-1819-4d72-828e-6f06c528d0d8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:47 devstack sudo[93827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ee0644ac-1819-4d72-828e-6f06c528d0d8 Jul 03 23:54:47 devstack sudo[93827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:47 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e.c589ede5-6fb6-4602-b167-5f9226562277" returned: 0 in 0.846s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-c589ede5-6fb6-4602-b167-5f9226562277" released by "_delete_snapshot" :: held 4.331s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e" released by "delete_snapshot" :: held 4.367s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:47 devstack cinder-volume[86676]: WARNING cinder.quota [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-430869051 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-430869051, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:54:47 devstack cinder-volume[86676]: WARNING cinder.quota [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-430869051 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-430869051, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:54:47 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Created reservations ['df46ba25-b2dd-49e6-b6ec-d8f0fde91e21', '2add5c8f-2339-4675-8441-ef302b94e920', '82dae666-69ec-4eac-a70a-f10cbc104e83', '2fe7e4aa-4e45-4c4a-abe5-538f77395ff3'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:54:47 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] Created reservations ['c25ed0da-deea-4673-b9cd-4f4576f001c9', '0158e1ae-d540-46df-b15c-13aade88affb', '8e77457a-c459-47ca-a2ea-7f4f3c8e0cf0', '5281fa68-ba1b-445a-b9b1-63555a7a5b35'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:54:47 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ce980e45-a947-4748-b415-f912f0bb881f tempest-GroupSnapshotsTest-2036801966 None] group_snapshot f30a29b0-6038-49a0-82a0-984573eb8d00: deleted successfully Jul 03 23:54:47 devstack sudo[93827]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ee0644ac-1819-4d72-828e-6f06c528d0d8" returned: 0 in 0.942s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:47 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0fb7269b-2276-47c7-8ee9-99cf6383b193" returned: 0 in 1.061s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] <== create_volume: return (2442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:54:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.446s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] Lock "cinder-quobyte-ee0644ac-1819-4d72-828e-6f06c528d0d8" released by "delete_volume" :: held 2.377s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dba9424-693f-4bee-9ff4-fa96724a0f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fb7269b-2276-47c7-8ee9-99cf6383b193', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fc0338-ed78-40a0-974e-40c32ee92915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:47 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Volume volume-0fb7269b-2276-47c7-8ee9-99cf6383b193 (0fb7269b-2276-47c7-8ee9-99cf6383b193): created successfully Jul 03 23:54:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fc0338-ed78-40a0-974e-40c32ee92915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Flow 'volume_create_manager' (c486747a-1a08-4333-b4b1-7243ff9317fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:54:47 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-178a6ba4-07e9-4c9b-a8e1-d586380107ea tempest-VolumesListAdminTestJSON-428172504 None] Created volume successfully. Jul 03 23:54:48 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] Created reservations ['fe35e411-a733-4242-a9bf-7ee89473a1c5', '168ee216-205b-4d2b-95c9-3c919d151675', '5c9fcf72-ee72-461b-a122-0e3cc240e3e0', 'c2c8673a-25f3-4a10-b040-a642e96fab88'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:54:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:54:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:54:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:48 devstack sudo[93850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:54:48 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "cinder-quobyte-390858f6-06e9-4ce8-91d3-a65d32493710" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-390858f6-06e9-4ce8-91d3-a65d32493710" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:48 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[24445068-90b8-4943-9263-89582934969f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:49 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710 Jul 03 23:54:49 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] Acquiring lock "cinder-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] Lock "cinder-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:49 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.108s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:54:49 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] Deleted volume successfully. Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] Acquiring lock "cinder-quobyte-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] Lock "cinder-quobyte-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca" acquired by "delete_volume" :: waited 0.060s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1a8df43e-5dc9-4c5d-a2b3-61e12ac0e367 tempest-AttachVolumeTestJSON-2023149251 None] Lock "cinder-ee0644ac-1819-4d72-828e-6f06c528d0d8-delete_volume" released by "delete_volume" :: held 4.208s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[677e0010-8b4c-4692-af3c-4874982f0b77]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Flow 'volume_create_manager' (0a2e0ecf-bf9a-4100-9120-23cebb1e293f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777978b1-d7bb-41b2-8e97-5e02e51b23e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777978b1-d7bb-41b2-8e97-5e02e51b23e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6024de30-cdb7-4440-8c57-2f9156a3dc66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f7fe9b58664338be26a927a9ba0a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:50Z,use_quota=True,user_id='d33d4bc60b0b4e9c8bd3596c464cd6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3f75b0-63b0-4b6d-ac94-e265c3fbd3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3f75b0-63b0-4b6d-ac94-e265c3fbd3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:49 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3820af90-d723-4202-9ac7-ad3f5053a6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:49 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3820af90-d723-4202-9ac7-ad3f5053a6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6024de30-cdb7-4440-8c57-2f9156a3dc66', 'volume_name': 'volume-6024de30-cdb7-4440-8c57-2f9156a3dc66', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84651fd-2deb-400a-aa7f-0d2abed3962c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84651fd-2deb-400a-aa7f-0d2abed3962c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb00f01e-8800-43fc-8245-7f1cb193431a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:49 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Volume 6024de30-cdb7-4440-8c57-2f9156a3dc66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6024de30-cdb7-4440-8c57-2f9156a3dc66', 'volume_size': 1} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6024de30-cdb7-4440-8c57-2f9156a3dc66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f7fe9b58664338be26a927a9ba0a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:50Z,use_quota=True,user_id='d33d4bc60b0b4e9c8bd3596c464cd6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Creating volume 6024de30-cdb7-4440-8c57-2f9156a3dc66 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:54:49 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:54:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6024de30-cdb7-4440-8c57-2f9156a3dc66 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:50 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6024de30-cdb7-4440-8c57-2f9156a3dc66 1073741824 Jul 03 23:54:50 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:50 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710" returned: 0 in 1.764s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:50 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710 Jul 03 23:54:50 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:51 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca" returned: 0 in 1.888s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:51 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca Jul 03 23:54:51 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:51 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6024de30-cdb7-4440-8c57-2f9156a3dc66 1073741824" returned: 0 in 2.014s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6024de30-cdb7-4440-8c57-2f9156a3dc66 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:52 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-390858f6-06e9-4ce8-91d3-a65d32493710" returned: 0 in 1.573s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:52 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6024de30-cdb7-4440-8c57-2f9156a3dc66 Jul 03 23:54:52 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-390858f6-06e9-4ce8-91d3-a65d32493710" released by "delete_volume" :: held 3.455s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "cinder-quobyte-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e" acquired by "delete_volume" :: waited 0.038s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:52 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18b1d55-6032-4757-a398-283f0e824eab]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:52 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e Jul 03 23:54:52 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:52 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca" returned: 0 in 1.320s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] Lock "cinder-quobyte-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca" released by "delete_volume" :: held 3.334s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:52 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] Created reservations ['d965f390-9259-461e-80b6-55b6476d9f5f', '14c81be1-3903-4f6e-ba8a-4544edaa295f', '98fb74f9-ed77-4bcc-a7e6-e9a550a5b0c2', '2c4d37f6-547b-45a5-8b3d-efad7456ba39'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:54:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:54:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:54:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:53 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:54:53 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:53 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6024de30-cdb7-4440-8c57-2f9156a3dc66" returned: 0 in 1.192s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] <== create_volume: return (3315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:54:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.322s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb00f01e-8800-43fc-8245-7f1cb193431a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6024de30-cdb7-4440-8c57-2f9156a3dc66', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1dc396a-dffc-4ae1-94fd-2bfe6c4f2ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:53 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Volume volume-6024de30-cdb7-4440-8c57-2f9156a3dc66 (6024de30-cdb7-4440-8c57-2f9156a3dc66): created successfully Jul 03 23:54:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1dc396a-dffc-4ae1-94fd-2bfe6c4f2ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Flow 'volume_create_manager' (0a2e0ecf-bf9a-4100-9120-23cebb1e293f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:54:53 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3b49e749-47f8-407e-b610-f5f9ab7b7b77 tempest-VolumesListAdminTestJSON-1617962452 None] Created volume successfully. Jul 03 23:54:53 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e" returned: 0 in 1.167s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:53 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e Jul 03 23:54:53 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] Acquiring lock "cinder-9fdad03a-5711-4bc1-a1fc-05403fd6a448-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] Lock "cinder-9fdad03a-5711-4bc1-a1fc-05403fd6a448-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:54 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=110,cinder:UPDATE=109,cinder:INSERT=23,cinder:DELETE=6 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:54:54 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=108,cinder:SELECT=114,cinder:INSERT=22,cinder:DELETE=5 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:54:54 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.143s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:54 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:54:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] Acquiring lock "cinder-quobyte-9fdad03a-5711-4bc1-a1fc-05403fd6a448" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:54 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] Deleted volume successfully. Jul 03 23:54:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] Lock "cinder-quobyte-9fdad03a-5711-4bc1-a1fc-05403fd6a448" acquired by "delete_volume" :: waited 0.078s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-09780f49-a642-48c7-88ca-07640e790f9e tempest-AttachVolumeTestJSON-2023149251 None] Lock "cinder-a28038fd-59c0-43a0-96a1-b6ac4e5c18ca-delete_volume" released by "delete_volume" :: held 5.192s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:54 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8805404f-ac8f-417d-bd03-91f7a045df0b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:54 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448 Jul 03 23:54:54 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] Acquiring lock "cinder-6024de30-cdb7-4440-8c57-2f9156a3dc66-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] Lock "cinder-6024de30-cdb7-4440-8c57-2f9156a3dc66-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:54 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e" returned: 0 in 1.330s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-5d5bda7b-97d5-4f07-a56f-c25f173f2e6e" released by "delete_volume" :: held 2.600s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] Acquiring lock "cinder-0fb7269b-2276-47c7-8ee9-99cf6383b193-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] Acquiring lock "cinder-quobyte-6024de30-cdb7-4440-8c57-2f9156a3dc66" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] Lock "cinder-0fb7269b-2276-47c7-8ee9-99cf6383b193-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] Lock "cinder-quobyte-6024de30-cdb7-4440-8c57-2f9156a3dc66" acquired by "delete_volume" :: waited 0.052s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:55 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dc35b4-3d50-478f-86c1-e8203e0dd63c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6024de30-cdb7-4440-8c57-2f9156a3dc66 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] Acquiring lock "cinder-quobyte-0fb7269b-2276-47c7-8ee9-99cf6383b193" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:55 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Created reservations ['4825c3db-1a86-475e-abe9-3ff0b5f40f03'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:54:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] Lock "cinder-quobyte-0fb7269b-2276-47c7-8ee9-99cf6383b193" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:55 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6024de30-cdb7-4440-8c57-2f9156a3dc66 Jul 03 23:54:55 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:55 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c60680-7b1a-40a6-ba54-19003f5671c7]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0fb7269b-2276-47c7-8ee9-99cf6383b193 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:55 devstack cinder-volume[86676]: WARNING cinder.quota [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-430869051 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-430869051, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:54:55 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Created reservations ['714b4761-b7e3-440b-b662-86ee938c8f7a', '6abd2d00-eff3-4a68-8d36-2475a4374c24', '364d3f4f-4779-48fb-8fe8-345656a9dd4d', 'a4526883-36aa-456e-a902-da2622da2116'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:54:55 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0fb7269b-2276-47c7-8ee9-99cf6383b193 Jul 03 23:54:55 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:55 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448" returned: 0 in 1.149s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:55 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448 Jul 03 23:54:55 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:55 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Created reservations ['beb547b9-c557-407b-a2e3-4c6541618e12', '223f4d07-9052-4ff5-8dba-aa30291a6d8e', '0c92973e-3e11-47fc-a4cf-7820b95f2667', 'fb07db15-74bb-436a-82dd-3ca30d042ac0'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:54:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:54:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:54:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:55 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:54:55 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:56 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0fb7269b-2276-47c7-8ee9-99cf6383b193" returned: 0 in 1.302s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0fb7269b-2276-47c7-8ee9-99cf6383b193 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:56 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6024de30-cdb7-4440-8c57-2f9156a3dc66" returned: 0 in 1.495s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6024de30-cdb7-4440-8c57-2f9156a3dc66 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:56 devstack sudo[93942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0fb7269b-2276-47c7-8ee9-99cf6383b193 Jul 03 23:54:56 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:56 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6024de30-cdb7-4440-8c57-2f9156a3dc66 Jul 03 23:54:56 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:56 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9fdad03a-5711-4bc1-a1fc-05403fd6a448" returned: 0 in 1.191s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] Lock "cinder-quobyte-9fdad03a-5711-4bc1-a1fc-05403fd6a448" released by "delete_volume" :: held 2.443s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:56 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.912s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:56 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:54:56 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-157ff9a3-3048-4667-af4b-08940eea5d45 tempest-GroupSnapshotsTest-2036801966 None] Delete group completed successfully. Jul 03 23:54:56 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] Created reservations ['35a0cddb-0e03-41e7-a670-dd29ddc4d4fa', 'c5f6f3b5-f640-451f-a84a-33aeae7cecfb', 'e82833c8-3831-47de-ab6a-231f972f0887', '4730744d-632a-4533-87b5-f67afc98c098'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:54:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:54:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:54:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:57 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:54:57 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:57 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0fb7269b-2276-47c7-8ee9-99cf6383b193" returned: 0 in 0.869s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] Lock "cinder-quobyte-0fb7269b-2276-47c7-8ee9-99cf6383b193" released by "delete_volume" :: held 2.263s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:57 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6024de30-cdb7-4440-8c57-2f9156a3dc66" returned: 0 in 0.910s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] Lock "cinder-quobyte-6024de30-cdb7-4440-8c57-2f9156a3dc66" released by "delete_volume" :: held 2.493s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:57 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] Created reservations ['9f933dd9-57bd-452c-9b2f-cc202a71f04d', '8c98340a-8930-4fb5-a9aa-1e9df79d4ae2', 'fdad1b6f-eb80-4ac0-92a8-c96c65b553f6', '237fc841-d4a4-4563-93e2-3400feeeb81a'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:54:57 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] Created reservations ['149f466a-e8a7-4479-a8c9-bdf38c535698', 'bb71206f-4956-4ddb-83b5-ffe411c2786f', 'b959b63c-ea9a-4bed-b70f-37d95b3f60f3', '2ad034b0-cb74-4831-9d00-2e797e5751a6'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:54:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fd51c65c-44b7-4218-b896-26eab5a6bcdb tempest-GroupSnapshotsTest-2036801966 None] Group tempest-GroupSnapshotsTest-Group-588068337: creating Jul 03 23:54:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:54:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:54:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:57 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:54:57 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fd51c65c-44b7-4218-b896-26eab5a6bcdb tempest-GroupSnapshotsTest-2036801966 None] Group tempest-GroupSnapshotsTest-Group-588068337: created successfully Jul 03 23:54:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fd51c65c-44b7-4218-b896-26eab5a6bcdb tempest-GroupSnapshotsTest-2036801966 None] Create group completed successfully. Jul 03 23:54:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:54:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:54:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:57 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:54:57 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:58 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.073s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:58 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:54:58 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] Deleted volume successfully. Jul 03 23:54:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce5d9968-4203-408b-b401-d7f3a695a97d tempest-AttachVolumeTestJSON-2023149251 None] Lock "cinder-9fdad03a-5711-4bc1-a1fc-05403fd6a448-delete_volume" released by "delete_volume" :: held 3.987s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] Acquiring lock "cinder-d18eb9cd-6a22-498a-b2df-27ab29a4615f-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] Lock "cinder-d18eb9cd-6a22-498a-b2df-27ab29a4615f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] Acquiring lock "cinder-quobyte-d18eb9cd-6a22-498a-b2df-27ab29a4615f" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:54:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] Lock "cinder-quobyte-d18eb9cd-6a22-498a-b2df-27ab29a4615f" acquired by "delete_volume" :: waited 0.044s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:54:58 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b12266-e45d-4761-a6a1-b3ffa82534a0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:54:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d18eb9cd-6a22-498a-b2df-27ab29a4615f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:58 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.914s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:58 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:54:58 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] Deleted volume successfully. Jul 03 23:54:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0b0b0933-9c60-45be-83c0-49c1a043dcb2 tempest-VolumesListAdminTestJSON-428172504 None] Lock "cinder-0fb7269b-2276-47c7-8ee9-99cf6383b193-delete_volume" released by "delete_volume" :: held 3.820s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:58 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d18eb9cd-6a22-498a-b2df-27ab29a4615f Jul 03 23:54:58 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:58 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.027s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:58 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:54:58 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] Deleted volume successfully. Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1fbf6cc4-da42-46d3-a3cb-35dc505eb8bb tempest-VolumesListAdminTestJSON-1617962452 None] Lock "cinder-6024de30-cdb7-4440-8c57-2f9156a3dc66-delete_volume" released by "delete_volume" :: held 4.279s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Flow 'volume_create_manager' (95f8743f-9302-4f1b-9dde-2982597421c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be882b8d-136a-4736-9546-790d2b8013e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be882b8d-136a-4736-9546-790d2b8013e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1421885713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=910b5ae2-1a5f-4269-a3bf-4c53febe1bb5,host='devstack@QuobyteHD#QuobyteHD',id=055d87fa-337a-450f-bc9a-46ebbe071143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c89ac31e0e49d182ffeb088372ee9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:00Z,use_quota=True,user_id='4a2f90aa79554115b2deb87d8cdb3712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01626b87-63a5-4958-93e5-caeb7caf35f4),volume_type_id=01626b87-63a5-4958-93e5-caeb7caf35f4)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a502022-b0fa-4d39-90d9-4ea7bd6d636a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a502022-b0fa-4d39-90d9-4ea7bd6d636a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68414a84-14c9-4445-9aa7-8aae5157cd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68414a84-14c9-4445-9aa7-8aae5157cd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '055d87fa-337a-450f-bc9a-46ebbe071143', 'volume_name': 'volume-055d87fa-337a-450f-bc9a-46ebbe071143', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a297380-a4da-4db6-93bd-72d299383be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a297380-a4da-4db6-93bd-72d299383be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab9d5b0-c297-4f60-8de9-31b63c7f5599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:54:59 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Volume 055d87fa-337a-450f-bc9a-46ebbe071143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-055d87fa-337a-450f-bc9a-46ebbe071143', 'volume_size': 1} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=910b5ae2-1a5f-4269-a3bf-4c53febe1bb5,created_at=2026-07-03T21:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1421885713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=910b5ae2-1a5f-4269-a3bf-4c53febe1bb5,host='devstack@QuobyteHD#QuobyteHD',id=055d87fa-337a-450f-bc9a-46ebbe071143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c89ac31e0e49d182ffeb088372ee9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:00Z,use_quota=True,user_id='4a2f90aa79554115b2deb87d8cdb3712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01626b87-63a5-4958-93e5-caeb7caf35f4),volume_type_id=01626b87-63a5-4958-93e5-caeb7caf35f4)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Creating volume 055d87fa-337a-450f-bc9a-46ebbe071143 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:54:59 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:59 devstack sudo[93967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143 1073741824 Jul 03 23:54:59 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:54:59 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d18eb9cd-6a22-498a-b2df-27ab29a4615f" returned: 0 in 1.260s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:54:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d18eb9cd-6a22-498a-b2df-27ab29a4615f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:54:59 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d18eb9cd-6a22-498a-b2df-27ab29a4615f Jul 03 23:54:59 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:01 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143 1073741824" returned: 0 in 1.382s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:01 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:01 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143 Jul 03 23:55:01 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d18eb9cd-6a22-498a-b2df-27ab29a4615f" returned: 0 in 1.327s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] Lock "cinder-quobyte-d18eb9cd-6a22-498a-b2df-27ab29a4615f" released by "delete_volume" :: held 2.667s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] Created reservations ['59a23c6b-9bf3-45f7-a1a8-64431e5aa337', '2957f6c9-ea01-4177-9bb6-5159b1e061a0', '099db62c-5da9-44fb-9a0c-283f593f0a96', 'a75096b9-d2cb-48ba-80d2-163bb7d33c88'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Flow 'volume_create_manager' (958bf39a-9924-4407-8444-1b7e2ee78946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025a66a2-1ac0-431c-8b30-cff1cef2eeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025a66a2-1ac0-431c-8b30-cff1cef2eeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-76360815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b43a56b-5fde-45e1-9244-69cfb733c212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d97e39b18e40f5ad059d17efc3f5e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:01Z,use_quota=True,user_id='e7766e63402f45eaa40118a6f8d18c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5fd17d-979f-4e43-acc8-5f0dcb9434c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5fd17d-979f-4e43-acc8-5f0dcb9434c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5444608-021a-4c4f-b6e1-69c37d56fc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5444608-021a-4c4f-b6e1-69c37d56fc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b43a56b-5fde-45e1-9244-69cfb733c212', 'volume_name': 'volume-8b43a56b-5fde-45e1-9244-69cfb733c212', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf1aa7a-18e6-43c7-a146-58bfcadec1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf1aa7a-18e6-43c7-a146-58bfcadec1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37cfee59-d03a-4d2b-95f4-e96dc0b7166a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:01 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Volume 8b43a56b-5fde-45e1-9244-69cfb733c212: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b43a56b-5fde-45e1-9244-69cfb733c212', 'volume_size': 1} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:01 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:55:01 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:02 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143" returned: 0 in 0.971s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] <== create_volume: return (2460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.463s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.647s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-76360815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b43a56b-5fde-45e1-9244-69cfb733c212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d97e39b18e40f5ad059d17efc3f5e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:01Z,use_quota=True,user_id='e7766e63402f45eaa40118a6f8d18c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Creating volume 8b43a56b-5fde-45e1-9244-69cfb733c212 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:55:02 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b43a56b-5fde-45e1-9244-69cfb733c212 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab9d5b0-c297-4f60-8de9-31b63c7f5599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-055d87fa-337a-450f-bc9a-46ebbe071143', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:02 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b43a56b-5fde-45e1-9244-69cfb733c212 1073741824 Jul 03 23:55:02 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504f8e33-97be-4c95-ba4d-be1ca7727725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:02 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Volume volume-055d87fa-337a-450f-bc9a-46ebbe071143 (055d87fa-337a-450f-bc9a-46ebbe071143): created successfully Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504f8e33-97be-4c95-ba4d-be1ca7727725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Flow 'volume_create_manager' (95f8743f-9302-4f1b-9dde-2982597421c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:02 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-56e707d3-8f45-4c86-99bf-414773f1d3e2 tempest-GroupSnapshotsTest-2036801966 None] Created volume successfully. Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] Acquiring lock "cinder-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] Lock "cinder-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] Acquiring lock "cinder-quobyte-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] Lock "cinder-quobyte-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d002c4-7355-44d2-bfe9-5111e9b0734f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:02 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.039s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:55:02 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0 Jul 03 23:55:02 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:02 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] Deleted volume successfully. Jul 03 23:55:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1a93e09b-ac5c-4c34-a2a0-6f36781f5ed2 tempest-VolumesListAdminTestJSON-428172504 None] Lock "cinder-d18eb9cd-6a22-498a-b2df-27ab29a4615f-delete_volume" released by "delete_volume" :: held 4.275s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:03 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b43a56b-5fde-45e1-9244-69cfb733c212 1073741824" returned: 0 in 1.255s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b43a56b-5fde-45e1-9244-69cfb733c212 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:03 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b43a56b-5fde-45e1-9244-69cfb733c212 Jul 03 23:55:03 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:03 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0" returned: 0 in 1.177s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:03 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0 Jul 03 23:55:03 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:03 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] GroupSnapshot d9f09fe9-905a-49c2-8bbe-62045048be2b: creating. Jul 03 23:55:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] Group snapshot d9f09fe9-905a-49c2-8bbe-62045048be2b: creating. {{(pid=86676) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jul 03 23:55:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:04 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b43a56b-5fde-45e1-9244-69cfb733c212" returned: 0 in 0.828s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] <== create_volume: return (2236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.239s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.438s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37cfee59-d03a-4d2b-95f4-e96dc0b7166a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b43a56b-5fde-45e1-9244-69cfb733c212', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72288771-d3e9-4857-9359-09a20b587b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] Creating offline snapshot c701bae3-b91f-4fa7-8c2d-dad4757a83cf of volume 055d87fa-337a-450f-bc9a-46ebbe071143 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 23:55:04 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Volume volume-8b43a56b-5fde-45e1-9244-69cfb733c212 (8b43a56b-5fde-45e1-9244-69cfb733c212): created successfully Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72288771-d3e9-4857-9359-09a20b587b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Flow 'volume_create_manager' (958bf39a-9924-4407-8444-1b7e2ee78946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efb12a0-bab8-4218-9bbf-04d138b3481a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:04 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c5a511ec-5ee4-492d-8d21-3287cf77c704 tempest-ServersNegativeTestJSON-1240870169 None] Created volume successfully. Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0" returned: 0 in 0.883s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] Lock "cinder-quobyte-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0" released by "delete_volume" :: held 2.131s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:04 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143 Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] Created reservations ['db687846-c406-4b90-9ba1-e3bde4937c8e', 'd6624b84-10ec-49da-9a3e-3df49c2f142c', '7ca5b55f-ca07-4ff4-b5e0-4be9bc9e4f52', '2fe8ae15-aca4-41dc-bf4c-30e170a56b1a'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:04 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:04 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:55:04 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:05 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143" returned: 0 in 0.966s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:05 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf 1G Jul 03 23:55:05 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:05 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.772s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:05 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:55:05 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] Deleted volume successfully. Jul 03 23:55:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bf2940d3-f70b-493b-8771-3e3f5ec51665 tempest-VolumesListAdminTestJSON-428172504 None] Lock "cinder-d8ebffe6-1a85-42cc-8f1d-4f503a9f22d0-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:06 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf 1G" returned: 0 in 1.109s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-055d87fa-337a-450f-bc9a-46ebbe071143 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:06 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-055d87fa-337a-450f-bc9a-46ebbe071143 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf Jul 03 23:55:06 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Flow 'volume_create_manager' (78bacf15-f05e-4f71-9959-c4b8f6185c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5128206e-f51d-4dc9-9784-f63a4434d78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5128206e-f51d-4dc9-9784-f63a4434d78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1014668650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e2e15d9-e586-4c94-ab13-61bd458d9fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d97e39b18e40f5ad059d17efc3f5e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:07Z,use_quota=True,user_id='e7766e63402f45eaa40118a6f8d18c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510c2594-5a0d-4cd7-b16c-90365529c7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510c2594-5a0d-4cd7-b16c-90365529c7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da10bd59-bb51-4633-92a9-f7dd00fc5020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da10bd59-bb51-4633-92a9-f7dd00fc5020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e2e15d9-e586-4c94-ab13-61bd458d9fe8', 'volume_name': 'volume-8e2e15d9-e586-4c94-ab13-61bd458d9fe8', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafafb43-f277-4051-8f2f-fb1466e20ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafafb43-f277-4051-8f2f-fb1466e20ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23dc4bc1-acb3-47a9-ba27-472bb6b4b8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:07 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Volume 8e2e15d9-e586-4c94-ab13-61bd458d9fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e2e15d9-e586-4c94-ab13-61bd458d9fe8', 'volume_size': 1} Jul 03 23:55:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:07 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-055d87fa-337a-450f-bc9a-46ebbe071143 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf" returned: 0 in 0.988s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:07 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf is being set with open permissions: ugo+rw: NotImplementedError Jul 03 23:55:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:07 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf Jul 03 23:55:07 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:08 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:55:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Flow 'volume_create_manager' (b7e543f4-b83b-4f02-ab24-8ab76a465438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158d39e2-633f-4dfd-8c87-324fda69c551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158d39e2-633f-4dfd-8c87-324fda69c551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-629701919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd608cc6-1fd7-4172-8f40-5d4f08ad462b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f233d47b91f54ee69a7a1343d87318f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:08Z,use_quota=True,user_id='6ea136725399483a89da313975c17bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b7d797-b0e0-4bea-b71e-a51d4aaf2fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b7d797-b0e0-4bea-b71e-a51d4aaf2fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410237fb-0bee-4fdf-8ed7-b76ca7131615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410237fb-0bee-4fdf-8ed7-b76ca7131615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd608cc6-1fd7-4172-8f40-5d4f08ad462b', 'volume_name': 'volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478391d2-358a-4c61-8a28-6969b2180d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478391d2-358a-4c61-8a28-6969b2180d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a88e91fc-9e69-48cf-9578-fbd5cce96922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:08 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Volume bd608cc6-1fd7-4172-8f40-5d4f08ad462b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b', 'volume_size': 1} Jul 03 23:55:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:08 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf" returned: 0 in 0.836s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:08 devstack sudo[94365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.info Jul 03 23:55:08 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:09 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.info" returned: 0 in 0.739s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:09 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 23:55:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:09 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.info Jul 03 23:55:09 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:09 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.info" returned: 0 in 0.711s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.493s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.394s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1014668650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e2e15d9-e586-4c94-ab13-61bd458d9fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d97e39b18e40f5ad059d17efc3f5e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:07Z,use_quota=True,user_id='e7766e63402f45eaa40118a6f8d18c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:55:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Creating volume 8e2e15d9-e586-4c94-ab13-61bd458d9fe8 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:55:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:55:09 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:55:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e2e15d9-e586-4c94-ab13-61bd458d9fe8 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:09 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e2e15d9-e586-4c94-ab13-61bd458d9fe8 1073741824 Jul 03 23:55:09 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f76d2dd7-622f-4486-aac8-70bd84a77a3e tempest-GroupSnapshotsTest-2036801966 None] group_snapshot d9f09fe9-905a-49c2-8bbe-62045048be2b: created successfully Jul 03 23:55:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] group_snapshot d9f09fe9-905a-49c2-8bbe-62045048be2b: deleting Jul 03 23:55:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] group_snapshot d9f09fe9-905a-49c2-8bbe-62045048be2b: deleting {{(pid=86676) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jul 03 23:55:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "cinder-quobyte-055d87fa-337a-450f-bc9a-46ebbe071143" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-055d87fa-337a-450f-bc9a-46ebbe071143" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "cinder-quobyte-c701bae3-b91f-4fa7-8c2d-dad4757a83cf" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-c701bae3-b91f-4fa7-8c2d-dad4757a83cf" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] Deleting offline snapshot c701bae3-b91f-4fa7-8c2d-dad4757a83cf of volume 055d87fa-337a-450f-bc9a-46ebbe071143 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 23:55:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] snapshot_file for this snap is: volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 23:55:10 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[df629c67-6cb4-4245-8582-a79d49f41b58]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:10 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf Jul 03 23:55:10 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:10 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e2e15d9-e586-4c94-ab13-61bd458d9fe8 1073741824" returned: 0 in 1.038s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e2e15d9-e586-4c94-ab13-61bd458d9fe8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:11 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e2e15d9-e586-4c94-ab13-61bd458d9fe8 Jul 03 23:55:11 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:11 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf" returned: 0 in 0.912s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-055d87fa-337a-450f-bc9a-46ebbe071143(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a260f89-3faa-46c0-9d70-5b2ddc44535c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:11 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e2e15d9-e586-4c94-ab13-61bd458d9fe8" returned: 0 in 0.760s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.427s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-629701919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd608cc6-1fd7-4172-8f40-5d4f08ad462b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f233d47b91f54ee69a7a1343d87318f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:08Z,use_quota=True,user_id='6ea136725399483a89da313975c17bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Creating volume bd608cc6-1fd7-4172-8f40-5d4f08ad462b {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:55:11 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:11 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b 1073741824 Jul 03 23:55:11 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23dc4bc1-acb3-47a9-ba27-472bb6b4b8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e2e15d9-e586-4c94-ab13-61bd458d9fe8', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09e0053-c7e5-474e-a074-5f15f2c5e1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:11 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Volume volume-8e2e15d9-e586-4c94-ab13-61bd458d9fe8 (8e2e15d9-e586-4c94-ab13-61bd458d9fe8): created successfully Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09e0053-c7e5-474e-a074-5f15f2c5e1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Flow 'volume_create_manager' (78bacf15-f05e-4f71-9959-c4b8f6185c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:11 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-34033adb-c86a-408f-a150-856570aee1ca tempest-ServersNegativeTestJSON-1240870169 None] Created volume successfully. Jul 03 23:55:11 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143 Jul 03 23:55:11 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:12 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143" returned: 0 in 0.939s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:12 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf Jul 03 23:55:12 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:12 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b 1073741824" returned: 0 in 1.054s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:12 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:55:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Flow 'volume_create_manager' (de135daa-a379-49f8-b59c-fa3b2865e58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7d3dea-7f6a-4279-8ba4-552242f1086e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7d3dea-7f6a-4279-8ba4-552242f1086e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-855529126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0398f0-ee72-48e9-a4b4-927c2f818f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1ee0d3a9fc48859da303373a1322db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:13Z,use_quota=True,user_id='bb8dfb83c6a84f4cbd02e8c85e8e1443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (681fdd63-8aec-4ccc-85fa-ac9365a6c87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (681fdd63-8aec-4ccc-85fa-ac9365a6c87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4690fc9c-1372-4ab6-be6d-1c45cbc54a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4690fc9c-1372-4ab6-be6d-1c45cbc54a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a0398f0-ee72-48e9-a4b4-927c2f818f3f', 'volume_name': 'volume-1a0398f0-ee72-48e9-a4b4-927c2f818f3f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6faf36-5d7e-43f8-bac3-b0ec61875d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6faf36-5d7e-43f8-bac3-b0ec61875d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19efe0c0-0ac5-417a-b3db-4361002dd784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:12 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Volume 1a0398f0-ee72-48e9-a4b4-927c2f818f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a0398f0-ee72-48e9-a4b4-927c2f818f3f', 'volume_size': 1} Jul 03 23:55:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:13 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b Jul 03 23:55:13 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] Acquiring lock "cinder-8e2e15d9-e586-4c94-ab13-61bd458d9fe8-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] Lock "cinder-8e2e15d9-e586-4c94-ab13-61bd458d9fe8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] Acquiring lock "cinder-quobyte-8e2e15d9-e586-4c94-ab13-61bd458d9fe8" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] Lock "cinder-quobyte-8e2e15d9-e586-4c94-ab13-61bd458d9fe8" acquired by "delete_volume" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[997697e3-a8c4-4787-b048-fcfa8e1e15a2]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e2e15d9-e586-4c94-ab13-61bd458d9fe8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:13 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e2e15d9-e586-4c94-ab13-61bd458d9fe8 Jul 03 23:55:13 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:13 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf" returned: 0 in 1.009s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:13 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf Jul 03 23:55:13 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:13 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b" returned: 0 in 0.829s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.853s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-855529126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0398f0-ee72-48e9-a4b4-927c2f818f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1ee0d3a9fc48859da303373a1322db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:13Z,use_quota=True,user_id='bb8dfb83c6a84f4cbd02e8c85e8e1443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Creating volume 1a0398f0-ee72-48e9-a4b4-927c2f818f3f {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:55:13 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1a0398f0-ee72-48e9-a4b4-927c2f818f3f 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a88e91fc-9e69-48cf-9578-fbd5cce96922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:13 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1a0398f0-ee72-48e9-a4b4-927c2f818f3f 1073741824 Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581b69ef-6cb6-470e-9d47-1fa5e4a19425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:13 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:13 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Volume volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b (bd608cc6-1fd7-4172-8f40-5d4f08ad462b): created successfully Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581b69ef-6cb6-470e-9d47-1fa5e4a19425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Flow 'volume_create_manager' (b7e543f4-b83b-4f02-ab24-8ab76a465438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:13 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-b84b63ea-7f9b-4496-97b0-11cebcf9cb19 req-c4f51564-a8e1-411b-909c-940a94d1bb16 tempest-VolumesSnapshotsTestJSON-304751937 None] Created volume successfully. Jul 03 23:55:14 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e2e15d9-e586-4c94-ab13-61bd458d9fe8" returned: 0 in 1.026s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e2e15d9-e586-4c94-ab13-61bd458d9fe8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:14 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e2e15d9-e586-4c94-ab13-61bd458d9fe8 Jul 03 23:55:14 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:14 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143.c701bae3-b91f-4fa7-8c2d-dad4757a83cf" returned: 0 in 0.890s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-c701bae3-b91f-4fa7-8c2d-dad4757a83cf" released by "_delete_snapshot" :: held 3.902s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-055d87fa-337a-450f-bc9a-46ebbe071143" released by "delete_snapshot" :: held 3.937s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:14 devstack cinder-volume[86676]: WARNING cinder.quota [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-114113601 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-114113601, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:55:14 devstack cinder-volume[86676]: WARNING cinder.quota [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-114113601 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-114113601, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:55:14 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] Created reservations ['39b8cb78-3e91-4e40-85d1-f7a303f5cd71', '8dc19bb5-9a62-4d26-becf-811ac18a605b', '1f2f67e6-6f29-4623-96ca-8ec18a5a6967', '18ff4c6d-94af-4fa5-a9f5-5c704bbb6973'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:15 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9cf98fab-5900-4f66-8c84-8c0ebcc46356 tempest-GroupSnapshotsTest-2036801966 None] group_snapshot d9f09fe9-905a-49c2-8bbe-62045048be2b: deleted successfully Jul 03 23:55:15 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1a0398f0-ee72-48e9-a4b4-927c2f818f3f 1073741824" returned: 0 in 1.527s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1a0398f0-ee72-48e9-a4b4-927c2f818f3f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-24c4addd-6864-42b1-9542-3d1b8dbcb5ea req-e3438e5c-7110-44cd-99cb-7f465b91be3e tempest-VolumesSnapshotsTestJSON-304751937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:15 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1a0398f0-ee72-48e9-a4b4-927c2f818f3f Jul 03 23:55:15 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:15 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7eeea30d-21ca-4129-8245-4f0d4e729121 tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "cinder-quobyte-055d87fa-337a-450f-bc9a-46ebbe071143" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e2e15d9-e586-4c94-ab13-61bd458d9fe8" returned: 0 in 1.221s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] Lock "cinder-quobyte-8e2e15d9-e586-4c94-ab13-61bd458d9fe8" released by "delete_volume" :: held 2.298s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7eeea30d-21ca-4129-8245-4f0d4e729121 tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-055d87fa-337a-450f-bc9a-46ebbe071143" acquired by "delete_volume" :: waited 0.039s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:15 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0dc866-72f0-4ce3-9df0-4394220e6b92]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7eeea30d-21ca-4129-8245-4f0d4e729121 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:15 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] Created reservations ['dcedbe2a-48be-4f4a-8ea9-18cfa11de49f', '380a414b-f75c-42f9-b38f-0616a3183586', '2c271105-cfcc-42ce-ae69-2d280655d7df', 'c48bcfdd-46b9-4453-adcc-41cb22e7d953'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:15 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143 Jul 03 23:55:15 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:16 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:55:16 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:16 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1a0398f0-ee72-48e9-a4b4-927c2f818f3f" returned: 0 in 0.784s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] <== create_volume: return (2399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.404s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-24c4addd-6864-42b1-9542-3d1b8dbcb5ea req-e3438e5c-7110-44cd-99cb-7f465b91be3e tempest-VolumesSnapshotsTestJSON-304751937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.771s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19efe0c0-0ac5-417a-b3db-4361002dd784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a0398f0-ee72-48e9-a4b4-927c2f818f3f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f13d6f6-d872-4d9d-b50e-141f2d428886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [req-24c4addd-6864-42b1-9542-3d1b8dbcb5ea req-e3438e5c-7110-44cd-99cb-7f465b91be3e tempest-VolumesSnapshotsTestJSON-304751937 None] Creating offline snapshot d8e9c735-5f28-48c5-aa0e-0de8fb40cb91 of volume bd608cc6-1fd7-4172-8f40-5d4f08ad462b {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 23:55:16 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Volume volume-1a0398f0-ee72-48e9-a4b4-927c2f818f3f (1a0398f0-ee72-48e9-a4b4-927c2f818f3f): created successfully Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f13d6f6-d872-4d9d-b50e-141f2d428886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Flow 'volume_create_manager' (de135daa-a379-49f8-b59c-fa3b2865e58e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3cb4f7-9883-4b06-a073-bbe72a855153]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-24c4addd-6864-42b1-9542-3d1b8dbcb5ea req-e3438e5c-7110-44cd-99cb-7f465b91be3e tempest-VolumesSnapshotsTestJSON-304751937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c4a12719-92fb-4323-b0e9-7cbfb969c13d tempest-VolumesTransfersTest-135191554 None] Created volume successfully. Jul 03 23:55:16 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b Jul 03 23:55:16 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:16 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7eeea30d-21ca-4129-8245-4f0d4e729121 tempest-GroupSnapshotsTest-2036801966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143" returned: 0 in 0.859s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7eeea30d-21ca-4129-8245-4f0d4e729121 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:16 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] Acquiring lock "cinder-8b43a56b-5fde-45e1-9244-69cfb733c212-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.736s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:16 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143 Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:55:16 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] Deleted volume successfully. Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] Lock "cinder-8b43a56b-5fde-45e1-9244-69cfb733c212-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a3849b6b-7379-47ad-a3d3-e942edc96f0a tempest-ServersNegativeTestJSON-1240870169 None] Lock "cinder-8e2e15d9-e586-4c94-ab13-61bd458d9fe8-delete_volume" released by "delete_volume" :: held 3.477s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] Acquiring lock "cinder-quobyte-8b43a56b-5fde-45e1-9244-69cfb733c212" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] Lock "cinder-quobyte-8b43a56b-5fde-45e1-9244-69cfb733c212" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f7d9e8-b7ca-4638-a5f5-26f309b96df6]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b43a56b-5fde-45e1-9244-69cfb733c212 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:16 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b43a56b-5fde-45e1-9244-69cfb733c212 Jul 03 23:55:16 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:17 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-24c4addd-6864-42b1-9542-3d1b8dbcb5ea req-e3438e5c-7110-44cd-99cb-7f465b91be3e tempest-VolumesSnapshotsTestJSON-304751937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b" returned: 0 in 0.928s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-24c4addd-6864-42b1-9542-3d1b8dbcb5ea req-e3438e5c-7110-44cd-99cb-7f465b91be3e tempest-VolumesSnapshotsTestJSON-304751937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:17 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91 1G Jul 03 23:55:17 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:17 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7eeea30d-21ca-4129-8245-4f0d4e729121 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-055d87fa-337a-450f-bc9a-46ebbe071143" returned: 0 in 0.790s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7eeea30d-21ca-4129-8245-4f0d4e729121 tempest-GroupSnapshotsTest-2036801966 None] Lock "cinder-quobyte-055d87fa-337a-450f-bc9a-46ebbe071143" released by "delete_volume" :: held 1.762s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:17 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-7eeea30d-21ca-4129-8245-4f0d4e729121 tempest-GroupSnapshotsTest-2036801966 None] Created reservations ['ef0e2c18-fdda-4188-8b30-68b91da19093'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:17 devstack cinder-volume[86676]: WARNING cinder.quota [None req-7eeea30d-21ca-4129-8245-4f0d4e729121 tempest-GroupSnapshotsTest-2036801966 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-114113601 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-114113601, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:55:17 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-7eeea30d-21ca-4129-8245-4f0d4e729121 tempest-GroupSnapshotsTest-2036801966 None] Created reservations ['d151681b-fb49-4721-bd88-952056ba6b25', '9c2d7492-bf86-49f9-b5dc-6dbd6a67198a', 'b0c6681f-cdec-4085-ae0d-efd53772ded9', 'f231e871-b48c-415b-85ac-dfb20ce9f096'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7eeea30d-21ca-4129-8245-4f0d4e729121 tempest-GroupSnapshotsTest-2036801966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7eeea30d-21ca-4129-8245-4f0d4e729121 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7eeea30d-21ca-4129-8245-4f0d4e729121 tempest-GroupSnapshotsTest-2036801966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7eeea30d-21ca-4129-8245-4f0d4e729121 tempest-GroupSnapshotsTest-2036801966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7eeea30d-21ca-4129-8245-4f0d4e729121 tempest-GroupSnapshotsTest-2036801966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7eeea30d-21ca-4129-8245-4f0d4e729121 tempest-GroupSnapshotsTest-2036801966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:17 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:55:17 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:17 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b43a56b-5fde-45e1-9244-69cfb733c212" returned: 0 in 1.067s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b43a56b-5fde-45e1-9244-69cfb733c212 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:17 devstack sudo[94541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b43a56b-5fde-45e1-9244-69cfb733c212 Jul 03 23:55:17 devstack sudo[94541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-52066877-c314-4f28-a42a-3dcb638456d4 tempest-VolumesTransfersTest-284611750 None] Transfer volume completed successfully. Jul 03 23:55:18 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-24c4addd-6864-42b1-9542-3d1b8dbcb5ea req-e3438e5c-7110-44cd-99cb-7f465b91be3e tempest-VolumesSnapshotsTestJSON-304751937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91 1G" returned: 0 in 1.021s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-24c4addd-6864-42b1-9542-3d1b8dbcb5ea req-e3438e5c-7110-44cd-99cb-7f465b91be3e tempest-VolumesSnapshotsTestJSON-304751937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:18 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91 Jul 03 23:55:18 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:18 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7eeea30d-21ca-4129-8245-4f0d4e729121 tempest-GroupSnapshotsTest-2036801966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.815s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:18 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-7eeea30d-21ca-4129-8245-4f0d4e729121 tempest-GroupSnapshotsTest-2036801966 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:55:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7eeea30d-21ca-4129-8245-4f0d4e729121 tempest-GroupSnapshotsTest-2036801966 None] Delete group completed successfully. Jul 03 23:55:18 devstack sudo[94541]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b43a56b-5fde-45e1-9244-69cfb733c212" returned: 0 in 0.926s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] Lock "cinder-quobyte-8b43a56b-5fde-45e1-9244-69cfb733c212" released by "delete_volume" :: held 2.043s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:18 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] Created reservations ['2eb873b5-fac3-464c-832c-46313e5206fd', 'b56e23c8-0d55-4964-b21d-7a1f26d586ba', '53e06cf2-dcb6-4ce4-a02b-cf4d2f3e0543', 'd94d9c49-5e49-42d1-89ab-7cd217c3abaf'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:19 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:55:19 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:19 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-24c4addd-6864-42b1-9542-3d1b8dbcb5ea req-e3438e5c-7110-44cd-99cb-7f465b91be3e tempest-VolumesSnapshotsTestJSON-304751937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91" returned: 0 in 0.953s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:19 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [req-24c4addd-6864-42b1-9542-3d1b8dbcb5ea req-e3438e5c-7110-44cd-99cb-7f465b91be3e tempest-VolumesSnapshotsTestJSON-304751937 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91 is being set with open permissions: ugo+rw Jul 03 23:55:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-24c4addd-6864-42b1-9542-3d1b8dbcb5ea req-e3438e5c-7110-44cd-99cb-7f465b91be3e tempest-VolumesSnapshotsTestJSON-304751937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:19 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91 Jul 03 23:55:19 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] Acquiring lock "cinder-1a0398f0-ee72-48e9-a4b4-927c2f818f3f-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] Lock "cinder-1a0398f0-ee72-48e9-a4b4-927c2f818f3f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] Acquiring lock "cinder-quobyte-1a0398f0-ee72-48e9-a4b4-927c2f818f3f" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] Lock "cinder-quobyte-1a0398f0-ee72-48e9-a4b4-927c2f818f3f" acquired by "delete_volume" :: waited 0.035s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:19 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[064c7d28-fff5-45a3-81da-62c5d3c0d090]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1a0398f0-ee72-48e9-a4b4-927c2f818f3f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:19 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1a0398f0-ee72-48e9-a4b4-927c2f818f3f Jul 03 23:55:19 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:19 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.846s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:19 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:55:19 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] Deleted volume successfully. Jul 03 23:55:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b66e9700-e06a-4dca-b424-04d91a9bd3a1 tempest-ServersNegativeTestJSON-1240870169 None] Lock "cinder-8b43a56b-5fde-45e1-9244-69cfb733c212-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:20 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-24c4addd-6864-42b1-9542-3d1b8dbcb5ea req-e3438e5c-7110-44cd-99cb-7f465b91be3e tempest-VolumesSnapshotsTestJSON-304751937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91" returned: 0 in 0.833s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-24c4addd-6864-42b1-9542-3d1b8dbcb5ea req-e3438e5c-7110-44cd-99cb-7f465b91be3e tempest-VolumesSnapshotsTestJSON-304751937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:20 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.info Jul 03 23:55:20 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:20 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1a0398f0-ee72-48e9-a4b4-927c2f818f3f" returned: 0 in 1.053s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1a0398f0-ee72-48e9-a4b4-927c2f818f3f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:20 devstack sudo[94569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1a0398f0-ee72-48e9-a4b4-927c2f818f3f Jul 03 23:55:20 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:21 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-24c4addd-6864-42b1-9542-3d1b8dbcb5ea req-e3438e5c-7110-44cd-99cb-7f465b91be3e tempest-VolumesSnapshotsTestJSON-304751937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.info" returned: 0 in 0.913s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:21 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [req-24c4addd-6864-42b1-9542-3d1b8dbcb5ea req-e3438e5c-7110-44cd-99cb-7f465b91be3e tempest-VolumesSnapshotsTestJSON-304751937 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.info is being set with open permissions: ugo+rw Jul 03 23:55:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-24c4addd-6864-42b1-9542-3d1b8dbcb5ea req-e3438e5c-7110-44cd-99cb-7f465b91be3e tempest-VolumesSnapshotsTestJSON-304751937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:21 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.info Jul 03 23:55:21 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:21 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1a0398f0-ee72-48e9-a4b4-927c2f818f3f" returned: 0 in 0.807s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] Lock "cinder-quobyte-1a0398f0-ee72-48e9-a4b4-927c2f818f3f" released by "delete_volume" :: held 1.948s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:21 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] Created reservations ['45eef118-baba-4144-85ca-269b477a76a6', '4e591a70-c9c3-4a8c-8c10-843ca118f246', '9ef684dd-4e4e-4b8e-b385-0f0c1b04f172', '2a3924c8-6219-4304-854e-9d6f6aca206c'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:21 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-24c4addd-6864-42b1-9542-3d1b8dbcb5ea req-e3438e5c-7110-44cd-99cb-7f465b91be3e tempest-VolumesSnapshotsTestJSON-304751937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.info" returned: 0 in 0.803s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:21 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:55:21 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-24c4addd-6864-42b1-9542-3d1b8dbcb5ea req-e3438e5c-7110-44cd-99cb-7f465b91be3e tempest-VolumesSnapshotsTestJSON-304751937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.592s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:21 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-24c4addd-6864-42b1-9542-3d1b8dbcb5ea req-e3438e5c-7110-44cd-99cb-7f465b91be3e tempest-VolumesSnapshotsTestJSON-304751937 None] Create snapshot completed successfully Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] Acquiring lock "cinder-d8e9c735-5f28-48c5-aa0e-0de8fb40cb91-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] Lock "cinder-d8e9c735-5f28-48c5-aa0e-0de8fb40cb91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] Acquiring lock "cinder-quobyte-bd608cc6-1fd7-4172-8f40-5d4f08ad462b" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] Lock "cinder-quobyte-bd608cc6-1fd7-4172-8f40-5d4f08ad462b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] Acquiring lock "cinder-quobyte-d8e9c735-5f28-48c5-aa0e-0de8fb40cb91" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] Lock "cinder-quobyte-d8e9c735-5f28-48c5-aa0e-0de8fb40cb91" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] Deleting offline snapshot d8e9c735-5f28-48c5-aa0e-0de8fb40cb91 of volume bd608cc6-1fd7-4172-8f40-5d4f08ad462b {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] snapshot_file for this snap is: volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ce578c-d495-4371-aa8a-f24678ff8cb1]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Flow 'volume_create_manager' (3a2e9c1e-c232-485b-a8b9-4b85b884241d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f7bc90-9642-4a9e-8f9b-f651a1df17f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:22 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91 Jul 03 23:55:22 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f7bc90-9642-4a9e-8f9b-f651a1df17f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1933066447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7035d1e5-3403-4a56-b924-436e095f5eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1ee0d3a9fc48859da303373a1322db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:23Z,use_quota=True,user_id='bb8dfb83c6a84f4cbd02e8c85e8e1443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d649b156-824a-4276-901b-b5c0ee48fde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d649b156-824a-4276-901b-b5c0ee48fde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8fcb8a-7081-4783-8c1a-80dc9a1bddbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8fcb8a-7081-4783-8c1a-80dc9a1bddbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7035d1e5-3403-4a56-b924-436e095f5eb6', 'volume_name': 'volume-7035d1e5-3403-4a56-b924-436e095f5eb6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9663ba59-100a-4114-bfb3-83472b37a1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9663ba59-100a-4114-bfb3-83472b37a1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:22 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886890aa-b177-4445-b281-ed2511d4173a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:22 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Volume 7035d1e5-3403-4a56-b924-436e095f5eb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7035d1e5-3403-4a56-b924-436e095f5eb6', 'volume_size': 1} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1933066447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7035d1e5-3403-4a56-b924-436e095f5eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1ee0d3a9fc48859da303373a1322db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:23Z,use_quota=True,user_id='bb8dfb83c6a84f4cbd02e8c85e8e1443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:55:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Creating volume 7035d1e5-3403-4a56-b924-436e095f5eb6 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:55:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:55:23 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:55:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7035d1e5-3403-4a56-b924-436e095f5eb6 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.247s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:23 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:55:23 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] Deleted volume successfully. Jul 03 23:55:23 devstack sudo[94603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7035d1e5-3403-4a56-b924-436e095f5eb6 1073741824 Jul 03 23:55:23 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6fbfbe07-a171-40e9-bf9b-a8f6af342e6b tempest-VolumesTransfersTest-426415495 None] Lock "cinder-1a0398f0-ee72-48e9-a4b4-927c2f818f3f-delete_volume" released by "delete_volume" :: held 3.524s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:24 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91" returned: 0 in 1.314s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:55:24 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6130e4c7-ed8b-4ba9-8da9-ec438560ed23]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:24 devstack sudo[94614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b Jul 03 23:55:24 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:24 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7035d1e5-3403-4a56-b924-436e095f5eb6 1073741824" returned: 0 in 1.267s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7035d1e5-3403-4a56-b924-436e095f5eb6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:24 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7035d1e5-3403-4a56-b924-436e095f5eb6 Jul 03 23:55:24 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:24 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b" returned: 0 in 0.925s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:25 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91 Jul 03 23:55:25 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:25 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7035d1e5-3403-4a56-b924-436e095f5eb6" returned: 0 in 0.837s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:55:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.168s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886890aa-b177-4445-b281-ed2511d4173a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7035d1e5-3403-4a56-b924-436e095f5eb6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65547c60-1cca-42ba-bd9f-e8ffa8c79293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:25 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Volume volume-7035d1e5-3403-4a56-b924-436e095f5eb6 (7035d1e5-3403-4a56-b924-436e095f5eb6): created successfully Jul 03 23:55:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65547c60-1cca-42ba-bd9f-e8ffa8c79293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Flow 'volume_create_manager' (3a2e9c1e-c232-485b-a8b9-4b85b884241d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:25 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8be620a9-2097-4edf-8941-c696613967ce tempest-VolumesTransfersTest-135191554 None] Created volume successfully. Jul 03 23:55:25 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ebc786e0-d705-4b77-8e06-98142623886b tempest-GroupSnapshotsV319Test-310047884 None] Group tempest-GroupSnapshotsV319Test-Group-2038482360: creating Jul 03 23:55:25 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ebc786e0-d705-4b77-8e06-98142623886b tempest-GroupSnapshotsV319Test-310047884 None] Group tempest-GroupSnapshotsV319Test-Group-2038482360: created successfully Jul 03 23:55:25 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ebc786e0-d705-4b77-8e06-98142623886b tempest-GroupSnapshotsV319Test-310047884 None] Create group completed successfully. Jul 03 23:55:25 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91" returned: 0 in 0.810s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:25 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91 Jul 03 23:55:25 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] Acquiring lock "cinder-7035d1e5-3403-4a56-b924-436e095f5eb6-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] Lock "cinder-7035d1e5-3403-4a56-b924-436e095f5eb6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] Acquiring lock "cinder-quobyte-7035d1e5-3403-4a56-b924-436e095f5eb6" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] Lock "cinder-quobyte-7035d1e5-3403-4a56-b924-436e095f5eb6" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:26 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cb540c-4c0b-4ce8-b2a6-6d17e5036c61]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7035d1e5-3403-4a56-b924-436e095f5eb6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:26 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7035d1e5-3403-4a56-b924-436e095f5eb6 Jul 03 23:55:26 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:26 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b.d8e9c735-5f28-48c5-aa0e-0de8fb40cb91" returned: 0 in 0.656s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] Lock "cinder-quobyte-d8e9c735-5f28-48c5-aa0e-0de8fb40cb91" released by "_delete_snapshot" :: held 3.881s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] Lock "cinder-quobyte-bd608cc6-1fd7-4172-8f40-5d4f08ad462b" released by "delete_snapshot" :: held 3.918s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:26 devstack cinder-volume[86676]: WARNING cinder.quota [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:55:26 devstack cinder-volume[86676]: DEBUG cinder.quota [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] Created reservations ['8821b952-3fbb-4b5a-a258-850e251192c6', '1019fd05-4376-473c-a07b-83c62afa374b', '19d4a3b3-43c2-41e7-a18d-e7b5de1f53d5', '1e4e2790-8356-4f08-b108-1adbed7ab28e'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:26 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] Delete snapshot completed successfully. Jul 03 23:55:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-a2961b3b-69f6-43cf-949c-947ec6f35473 req-cc9a1126-d1b0-4ac9-9506-faa919732225 tempest-VolumesSnapshotsTestJSON-304751937 None] Lock "cinder-d8e9c735-5f28-48c5-aa0e-0de8fb40cb91-delete_snapshot" released by "delete_snapshot" :: held 4.077s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Flow 'volume_create_manager' (fb57f5bc-9ca3-4e83-a74c-cc353e59dea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2acea036-20ba-4691-9d87-50ffdeefd148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2acea036-20ba-4691-9d87-50ffdeefd148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-591642791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2419093a-f6ae-48cb-812f-1036ad33047c,host='devstack@QuobyteHD#QuobyteHD',id=0c9a034c-5045-4ea4-bb2c-94049873f90c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0d4b94d97948468d84c1a499f7d38a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:27Z,use_quota=True,user_id='2eb6ee98b64a4376a2ec0da72a91cbfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9351cdc7-d4f9-4242-83ff-40f63e3aaadd),volume_type_id=9351cdc7-d4f9-4242-83ff-40f63e3aaadd)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147c2536-3d7d-4daa-95e0-6f21b78692e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147c2536-3d7d-4daa-95e0-6f21b78692e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeaa2a2e-1144-4846-b2fb-b4408a15216c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeaa2a2e-1144-4846-b2fb-b4408a15216c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c9a034c-5045-4ea4-bb2c-94049873f90c', 'volume_name': 'volume-0c9a034c-5045-4ea4-bb2c-94049873f90c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229e9b2d-dd1a-4fd0-91d6-5f2dd08adb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:27 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229e9b2d-dd1a-4fd0-91d6-5f2dd08adb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848e7ea1-301e-4a45-ad5a-066663bce6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:27 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Volume 0c9a034c-5045-4ea4-bb2c-94049873f90c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c9a034c-5045-4ea4-bb2c-94049873f90c', 'volume_size': 1} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2419093a-f6ae-48cb-812f-1036ad33047c,created_at=2026-07-03T21:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-591642791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2419093a-f6ae-48cb-812f-1036ad33047c,host='devstack@QuobyteHD#QuobyteHD',id=0c9a034c-5045-4ea4-bb2c-94049873f90c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0d4b94d97948468d84c1a499f7d38a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:27Z,use_quota=True,user_id='2eb6ee98b64a4376a2ec0da72a91cbfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9351cdc7-d4f9-4242-83ff-40f63e3aaadd),volume_type_id=9351cdc7-d4f9-4242-83ff-40f63e3aaadd)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Creating volume 0c9a034c-5045-4ea4-bb2c-94049873f90c {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:55:27 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] Acquiring lock "cinder-bd608cc6-1fd7-4172-8f40-5d4f08ad462b-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7035d1e5-3403-4a56-b924-436e095f5eb6" returned: 0 in 0.995s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7035d1e5-3403-4a56-b924-436e095f5eb6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:27 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c 1073741824 Jul 03 23:55:27 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] Lock "cinder-bd608cc6-1fd7-4172-8f40-5d4f08ad462b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:27 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7035d1e5-3403-4a56-b924-436e095f5eb6 Jul 03 23:55:27 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] Acquiring lock "cinder-quobyte-bd608cc6-1fd7-4172-8f40-5d4f08ad462b" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] Lock "cinder-quobyte-bd608cc6-1fd7-4172-8f40-5d4f08ad462b" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[06845b5d-67c8-4da7-86ec-672bdc354f09]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:27 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b Jul 03 23:55:27 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:27 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7035d1e5-3403-4a56-b924-436e095f5eb6" returned: 0 in 0.680s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] Lock "cinder-quobyte-7035d1e5-3403-4a56-b924-436e095f5eb6" released by "delete_volume" :: held 1.719s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:28 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] Created reservations ['80f565f9-6441-4df6-8d48-0bb29e3e9655', '36381d8b-e415-4476-b0de-2178867f4278', 'f1aedfb7-cbad-43de-9962-d8fd3b19ef0f', 'ef89bccb-7287-4f5d-a123-82131fdde680'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:28 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:55:28 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:28 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c 1073741824" returned: 0 in 0.941s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:28 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b" returned: 0 in 0.830s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:28 devstack sudo[94651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c Jul 03 23:55:28 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:28 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b Jul 03 23:55:28 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:29 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c" returned: 0 in 0.881s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:29 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848e7ea1-301e-4a45-ad5a-066663bce6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c9a034c-5045-4ea4-bb2c-94049873f90c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b2bf9d-5634-467d-b256-c20b4332c269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.057s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:55:29 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] Deleted volume successfully. Jul 03 23:55:29 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Volume volume-0c9a034c-5045-4ea4-bb2c-94049873f90c (0c9a034c-5045-4ea4-bb2c-94049873f90c): created successfully Jul 03 23:55:29 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b2bf9d-5634-467d-b256-c20b4332c269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Flow 'volume_create_manager' (fb57f5bc-9ca3-4e83-a74c-cc353e59dea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bd608cc6-1fd7-4172-8f40-5d4f08ad462b" returned: 0 in 0.977s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d0c173a5-feb0-4730-9499-88ca910b7a2c tempest-VolumesTransfersTest-426415495 None] Lock "cinder-7035d1e5-3403-4a56-b924-436e095f5eb6-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] Lock "cinder-quobyte-bd608cc6-1fd7-4172-8f40-5d4f08ad462b" released by "delete_volume" :: held 1.888s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:29 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0e613095-7617-484a-9cbd-6d0e6ad730b8 tempest-GroupSnapshotsV319Test-310047884 None] Created volume successfully. Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG cinder.quota [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] Created reservations ['4c671bb7-1ed0-4686-92f6-b38ad42ad7bc', '944c7ff9-5153-400b-93b0-a9a212395fbf', '9ca458e3-e207-46fe-9a92-05b2a1cf9c3e', '4e05c2cb-7f7b-451a-b8bd-98f37bf47f38'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:29 devstack sudo[94660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:55:29 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:29 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] GroupSnapshot fdef918a-cf36-448a-8cf2-a370e311814f: creating. Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] Group snapshot fdef918a-cf36-448a-8cf2-a370e311814f: creating. {{(pid=86676) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] Creating offline snapshot 10258e7f-eee2-41d0-a6c8-21261fb3af40 of volume 0c9a034c-5045-4ea4-bb2c-94049873f90c {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 23:55:30 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d261ff7f-6324-4c59-8613-69b7337416e3]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:30 devstack sudo[94662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c Jul 03 23:55:30 devstack sudo[94662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:30 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.131s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:30 devstack cinder-volume[86676]: DEBUG cinder.manager [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:55:30 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] Deleted volume successfully. Jul 03 23:55:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-d1f609a4-f5f2-454e-b8cd-1df6c8d74ea7 req-c2db342e-628a-49b3-9607-4874cad00e04 tempest-VolumesSnapshotsTestJSON-304751937 None] Lock "cinder-bd608cc6-1fd7-4172-8f40-5d4f08ad462b-delete_volume" released by "delete_volume" :: held 3.404s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:31 devstack sudo[94662]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c" returned: 0 in 1.068s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:31 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40 1G Jul 03 23:55:31 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:32 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40 1G" returned: 0 in 0.947s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c9a034c-5045-4ea4-bb2c-94049873f90c -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:32 devstack sudo[94675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c9a034c-5045-4ea4-bb2c-94049873f90c -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40 Jul 03 23:55:32 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:55:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:33 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c9a034c-5045-4ea4-bb2c-94049873f90c -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40" returned: 0 in 1.284s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:33 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 23:55:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:33 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:55:33 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:33 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40 Jul 03 23:55:33 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:34 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40" returned: 0 in 1.113s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:34 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.206s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:55:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:55:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 8 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 23:55:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 03 23:55:34 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.info Jul 03 23:55:34 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:35 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.info" returned: 0 in 0.989s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:35 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 23:55:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:35 devstack sudo[94727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.info Jul 03 23:55:35 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:36 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.info" returned: 0 in 0.805s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.344s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:36 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1f40dc87-fd13-4806-8c0d-13dd68907571 tempest-GroupSnapshotsV319Test-310047884 None] group_snapshot fdef918a-cf36-448a-8cf2-a370e311814f: created successfully Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Flow 'volume_create_manager' (72d1e85b-f869-402e-afc4-3128f90e4cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbba1ff7-5e76-4f1d-94cb-c144dd89babf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbba1ff7-5e76-4f1d-94cb-c144dd89babf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-851508141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7976adb-d502-4d88-8142-4358477f8f80,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4ff4db9795e405684f9fe500a103bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:37Z,use_quota=True,user_id='1e497a176be749e6aea06fd94300c691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1081fe6-0269-4e7c-aa31-b11bde16fc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1081fe6-0269-4e7c-aa31-b11bde16fc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4ec34c-2326-4a74-aea9-fab82598eca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4ec34c-2326-4a74-aea9-fab82598eca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7976adb-d502-4d88-8142-4358477f8f80', 'volume_name': 'volume-d7976adb-d502-4d88-8142-4358477f8f80', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496b6736-e9c3-439d-808f-a0e9abce2af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496b6736-e9c3-439d-808f-a0e9abce2af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f5626a-1ec4-4269-9e51-4d49cd0dc729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:36 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Volume d7976adb-d502-4d88-8142-4358477f8f80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7976adb-d502-4d88-8142-4358477f8f80', 'volume_size': 1} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-851508141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7976adb-d502-4d88-8142-4358477f8f80,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4ff4db9795e405684f9fe500a103bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:37Z,use_quota=True,user_id='1e497a176be749e6aea06fd94300c691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Creating volume d7976adb-d502-4d88-8142-4358477f8f80 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:55:36 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:55:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d7976adb-d502-4d88-8142-4358477f8f80 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:36 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d7976adb-d502-4d88-8142-4358477f8f80 1073741824 Jul 03 23:55:36 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:37 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d7976adb-d502-4d88-8142-4358477f8f80 1073741824" returned: 0 in 1.073s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d7976adb-d502-4d88-8142-4358477f8f80 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:37 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d7976adb-d502-4d88-8142-4358477f8f80 Jul 03 23:55:37 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:37 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] group_snapshot fdef918a-cf36-448a-8cf2-a370e311814f: deleting Jul 03 23:55:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] group_snapshot fdef918a-cf36-448a-8cf2-a370e311814f: deleting {{(pid=86676) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jul 03 23:55:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] Acquiring lock "cinder-quobyte-0c9a034c-5045-4ea4-bb2c-94049873f90c" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] Lock "cinder-quobyte-0c9a034c-5045-4ea4-bb2c-94049873f90c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] Acquiring lock "cinder-quobyte-10258e7f-eee2-41d0-a6c8-21261fb3af40" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] Lock "cinder-quobyte-10258e7f-eee2-41d0-a6c8-21261fb3af40" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] Deleting offline snapshot 10258e7f-eee2-41d0-a6c8-21261fb3af40 of volume 0c9a034c-5045-4ea4-bb2c-94049873f90c {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 23:55:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] snapshot_file for this snap is: volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 23:55:38 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fc2934-2fcd-495f-816e-a52ce4652531]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:38 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40 Jul 03 23:55:38 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:38 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d7976adb-d502-4d88-8142-4358477f8f80" returned: 0 in 0.866s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] <== create_volume: return (2002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:55:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f5626a-1ec4-4269-9e51-4d49cd0dc729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7976adb-d502-4d88-8142-4358477f8f80', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01122692-4b9a-435a-8f2f-ccfc8fa4d6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Volume volume-d7976adb-d502-4d88-8142-4358477f8f80 (d7976adb-d502-4d88-8142-4358477f8f80): created successfully Jul 03 23:55:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01122692-4b9a-435a-8f2f-ccfc8fa4d6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Flow 'volume_create_manager' (72d1e85b-f869-402e-afc4-3128f90e4cb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7f43f641-b039-4a99-bb25-3f634a11fdab tempest-VolumesTestJSON-177249583 None] Created volume successfully. Jul 03 23:55:39 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40" returned: 0 in 1.044s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c9a034c-5045-4ea4-bb2c-94049873f90c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b981fd-c443-45ae-bf66-1075a8fc45cb]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Flow 'volume_create_manager' (fae36e1d-6099-423a-93d5-b9e6e48c7c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a09f8ef-db0f-442a-b59d-0d31a482f85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a09f8ef-db0f-442a-b59d-0d31a482f85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1766779237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d42b603-b90d-4c13-8b23-6c44b6065291,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d035fe6b8bcd41999a8214d39aa895ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:39Z,use_quota=True,user_id='b514cbb6526e4a4393e6194d91366d98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423556a6-8faa-4115-994d-d873ff93e2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423556a6-8faa-4115-994d-d873ff93e2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16b3ad4-7261-463c-84df-9fe1d28793d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:39 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c Jul 03 23:55:39 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16b3ad4-7261-463c-84df-9fe1d28793d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d42b603-b90d-4c13-8b23-6c44b6065291', 'volume_name': 'volume-6d42b603-b90d-4c13-8b23-6c44b6065291', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3185d494-abf5-4d29-9884-0446d586ba88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3185d494-abf5-4d29-9884-0446d586ba88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb4ed61-3faa-4a45-a971-f08eb01ebc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:39 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Volume 6d42b603-b90d-4c13-8b23-6c44b6065291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d42b603-b90d-4c13-8b23-6c44b6065291', 'volume_size': 1} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1766779237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d42b603-b90d-4c13-8b23-6c44b6065291,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d035fe6b8bcd41999a8214d39aa895ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:39Z,use_quota=True,user_id='b514cbb6526e4a4393e6194d91366d98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Creating volume 6d42b603-b90d-4c13-8b23-6c44b6065291 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:55:39 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6d42b603-b90d-4c13-8b23-6c44b6065291 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:39 devstack sudo[94749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6d42b603-b90d-4c13-8b23-6c44b6065291 1073741824 Jul 03 23:55:39 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Flow 'volume_create_manager' (f2e2b392-489e-4827-b5ca-c48e2a621ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74a4ccc-f505-4dde-98bd-c0b68b1e1de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74a4ccc-f505-4dde-98bd-c0b68b1e1de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2137344056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf76088f-1da9-4e42-8ec5-05c56c43e8c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4b7f3ffcc04252923a8b1c5c96337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:40Z,use_quota=True,user_id='a7f7470215504607ab776296c14a9ccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b2246aa-05f0-4606-8bca-4a76b5ac391f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b2246aa-05f0-4606-8bca-4a76b5ac391f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18766884-5b4a-4a41-b2e0-3d3b02ee0902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18766884-5b4a-4a41-b2e0-3d3b02ee0902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf76088f-1da9-4e42-8ec5-05c56c43e8c8', 'volume_name': 'volume-bf76088f-1da9-4e42-8ec5-05c56c43e8c8', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268d0830-e6d2-46f4-9c11-e9b0681ef580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268d0830-e6d2-46f4-9c11-e9b0681ef580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189dcf80-a512-416a-a9ab-12d0ac33d866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:39 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Volume bf76088f-1da9-4e42-8ec5-05c56c43e8c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf76088f-1da9-4e42-8ec5-05c56c43e8c8', 'volume_size': 1} Jul 03 23:55:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:40 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c" returned: 0 in 0.923s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:40 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40 Jul 03 23:55:40 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:40 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6d42b603-b90d-4c13-8b23-6c44b6065291 1073741824" returned: 0 in 1.051s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:40 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:55:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Flow 'volume_create_manager' (a776dccf-f082-4b13-bb52-3590ceab2bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68ea457-203a-4a04-a923-01fe1221e4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68ea457-203a-4a04-a923-01fe1221e4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1052896998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3080a916-54d7-4b1a-b94d-23e76ab615ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4ff4db9795e405684f9fe500a103bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:40Z,use_quota=True,user_id='1e497a176be749e6aea06fd94300c691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41cba17c-a4c1-4fad-bec4-615ef6e4cbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41cba17c-a4c1-4fad-bec4-615ef6e4cbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f207abe2-0276-40cb-9356-4f5544017b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f207abe2-0276-40cb-9356-4f5544017b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3080a916-54d7-4b1a-b94d-23e76ab615ef', 'volume_name': 'volume-3080a916-54d7-4b1a-b94d-23e76ab615ef', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0628dc9-dafa-4400-b7f8-0f9e1633cc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0628dc9-dafa-4400-b7f8-0f9e1633cc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782f3e73-50b3-49e6-b6cd-6113fa9d5baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:40 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Volume 3080a916-54d7-4b1a-b94d-23e76ab615ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3080a916-54d7-4b1a-b94d-23e76ab615ef', 'volume_size': 1} Jul 03 23:55:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6d42b603-b90d-4c13-8b23-6c44b6065291 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:40 devstack sudo[94762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6d42b603-b90d-4c13-8b23-6c44b6065291 Jul 03 23:55:40 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:40 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40" returned: 0 in 0.834s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:40 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40 Jul 03 23:55:40 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:41 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6d42b603-b90d-4c13-8b23-6c44b6065291" returned: 0 in 0.785s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] <== create_volume: return (1996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.515s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2137344056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf76088f-1da9-4e42-8ec5-05c56c43e8c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4b7f3ffcc04252923a8b1c5c96337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:40Z,use_quota=True,user_id='a7f7470215504607ab776296c14a9ccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Creating volume bf76088f-1da9-4e42-8ec5-05c56c43e8c8 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:55:41 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bf76088f-1da9-4e42-8ec5-05c56c43e8c8 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:41 devstack sudo[94770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bf76088f-1da9-4e42-8ec5-05c56c43e8c8 1073741824 Jul 03 23:55:41 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb4ed61-3faa-4a45-a971-f08eb01ebc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d42b603-b90d-4c13-8b23-6c44b6065291', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55c23de-6cc6-49a8-a737-8f072c0a4c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:41 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Volume volume-6d42b603-b90d-4c13-8b23-6c44b6065291 (6d42b603-b90d-4c13-8b23-6c44b6065291): created successfully Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55c23de-6cc6-49a8-a737-8f072c0a4c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Flow 'volume_create_manager' (fae36e1d-6099-423a-93d5-b9e6e48c7c54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:41 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-0c05c780-840e-4ccf-94c4-5cc3eec6b942 req-668c7a29-9d9b-4307-877f-732d4e1ccdc7 tempest-VolumesGetTestJSON-1308791173 None] Created volume successfully. Jul 03 23:55:41 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c.10258e7f-eee2-41d0-a6c8-21261fb3af40" returned: 0 in 0.670s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] Lock "cinder-quobyte-10258e7f-eee2-41d0-a6c8-21261fb3af40" released by "_delete_snapshot" :: held 3.600s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] Lock "cinder-quobyte-0c9a034c-5045-4ea4-bb2c-94049873f90c" released by "delete_snapshot" :: held 3.631s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:41 devstack cinder-volume[86676]: WARNING cinder.quota [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-456858689 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-456858689, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:55:41 devstack cinder-volume[86676]: WARNING cinder.quota [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-456858689 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-456858689, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:55:41 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] Created reservations ['f805eff6-ad42-483f-83da-7fdc29d62959', '2979a973-05db-479d-b78b-0ce69f9ab795', '1f826404-b788-4318-add2-cb12569a9b86', 'ae875f07-5915-4f94-b0e1-fdcb6f26569e'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:41 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-84e1e133-ca17-4adc-9996-79b3dabe7b94 tempest-GroupSnapshotsV319Test-310047884 None] group_snapshot fdef918a-cf36-448a-8cf2-a370e311814f: deleted successfully Jul 03 23:55:42 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bf76088f-1da9-4e42-8ec5-05c56c43e8c8 1073741824" returned: 0 in 0.848s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bf76088f-1da9-4e42-8ec5-05c56c43e8c8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:42 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bf76088f-1da9-4e42-8ec5-05c56c43e8c8 Jul 03 23:55:42 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9ee30357-9417-4f72-ad93-fe6be2dbb00c tempest-GroupSnapshotsV319Test-310047884 None] Acquiring lock "cinder-quobyte-0c9a034c-5045-4ea4-bb2c-94049873f90c" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9ee30357-9417-4f72-ad93-fe6be2dbb00c tempest-GroupSnapshotsV319Test-310047884 None] Lock "cinder-quobyte-0c9a034c-5045-4ea4-bb2c-94049873f90c" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] Acquiring lock "cinder-6d42b603-b90d-4c13-8b23-6c44b6065291-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:42 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4b128e-af3a-4db3-8338-e061854cb695]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ee30357-9417-4f72-ad93-fe6be2dbb00c tempest-GroupSnapshotsV319Test-310047884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bf76088f-1da9-4e42-8ec5-05c56c43e8c8" returned: 0 in 0.748s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] Lock "cinder-6d42b603-b90d-4c13-8b23-6c44b6065291-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.474s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1052896998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3080a916-54d7-4b1a-b94d-23e76ab615ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4ff4db9795e405684f9fe500a103bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:40Z,use_quota=True,user_id='1e497a176be749e6aea06fd94300c691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Creating volume 3080a916-54d7-4b1a-b94d-23e76ab615ef {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:55:42 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:55:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3080a916-54d7-4b1a-b94d-23e76ab615ef 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:43 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3080a916-54d7-4b1a-b94d-23e76ab615ef 1073741824 Jul 03 23:55:43 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189dcf80-a512-416a-a9ab-12d0ac33d866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf76088f-1da9-4e42-8ec5-05c56c43e8c8', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb05ccbe-4e92-4301-a65c-464ce548c14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:43 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Volume volume-bf76088f-1da9-4e42-8ec5-05c56c43e8c8 (bf76088f-1da9-4e42-8ec5-05c56c43e8c8): created successfully Jul 03 23:55:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb05ccbe-4e92-4301-a65c-464ce548c14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Flow 'volume_create_manager' (f2e2b392-489e-4827-b5ca-c48e2a621ec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] Acquiring lock "cinder-quobyte-6d42b603-b90d-4c13-8b23-6c44b6065291" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-78f9118c-c41c-40e6-aff5-2349174222dd tempest-VolumesTransfersV355Test-1752384957 None] Created volume successfully. Jul 03 23:55:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] Lock "cinder-quobyte-6d42b603-b90d-4c13-8b23-6c44b6065291" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:43 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c Jul 03 23:55:43 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:43 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a20776e-9044-485f-8664-af8703970357]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6d42b603-b90d-4c13-8b23-6c44b6065291 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:43 devstack sudo[94784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6d42b603-b90d-4c13-8b23-6c44b6065291 Jul 03 23:55:43 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:43 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ee30357-9417-4f72-ad93-fe6be2dbb00c tempest-GroupSnapshotsV319Test-310047884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c" returned: 0 in 0.882s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ee30357-9417-4f72-ad93-fe6be2dbb00c tempest-GroupSnapshotsV319Test-310047884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:43 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c Jul 03 23:55:43 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:43 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3080a916-54d7-4b1a-b94d-23e76ab615ef 1073741824" returned: 0 in 0.943s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:43 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6d42b603-b90d-4c13-8b23-6c44b6065291" returned: 0 in 0.831s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6d42b603-b90d-4c13-8b23-6c44b6065291 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:43 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6d42b603-b90d-4c13-8b23-6c44b6065291 Jul 03 23:55:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3080a916-54d7-4b1a-b94d-23e76ab615ef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:43 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:44 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3080a916-54d7-4b1a-b94d-23e76ab615ef Jul 03 23:55:44 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:44 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ee30357-9417-4f72-ad93-fe6be2dbb00c tempest-GroupSnapshotsV319Test-310047884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0c9a034c-5045-4ea4-bb2c-94049873f90c" returned: 0 in 0.896s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:44 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6d42b603-b90d-4c13-8b23-6c44b6065291" returned: 0 in 0.792s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9ee30357-9417-4f72-ad93-fe6be2dbb00c tempest-GroupSnapshotsV319Test-310047884 None] Lock "cinder-quobyte-0c9a034c-5045-4ea4-bb2c-94049873f90c" released by "delete_volume" :: held 1.895s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] Lock "cinder-quobyte-6d42b603-b90d-4c13-8b23-6c44b6065291" released by "delete_volume" :: held 1.672s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:44 devstack cinder-volume[86676]: DEBUG cinder.quota [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] Created reservations ['9cf6833e-5d69-43a8-902a-90f08c14d5a5', '1c46d877-5d2f-4b9d-8dd6-2d34551510c0', 'd533cfcb-d3f4-4fa3-969c-54cff623effb', 'f9584504-320a-4931-b171-bd49ceaec00d'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:44 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-9ee30357-9417-4f72-ad93-fe6be2dbb00c tempest-GroupSnapshotsV319Test-310047884 None] Created reservations ['927e0593-481e-4e4b-8903-f9549088474b'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:44 devstack cinder-volume[86676]: WARNING cinder.quota [None req-9ee30357-9417-4f72-ad93-fe6be2dbb00c tempest-GroupSnapshotsV319Test-310047884 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-456858689 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-456858689, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:55:44 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-48773f0b-0d8e-418e-80c9-5d470fa4ee2a tempest-VolumesTransfersV355Test-226586382 None] Transfer volume completed successfully. Jul 03 23:55:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:44 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-9ee30357-9417-4f72-ad93-fe6be2dbb00c tempest-GroupSnapshotsV319Test-310047884 None] Created reservations ['11515e31-4691-4fb0-b979-3ef063eba010', '656cff68-7a06-4ee2-9653-d0c6246fbb6b', '32f5cd07-d5e7-49fa-8f98-eab0eab3183d', 'cecccc47-bf4f-4df9-8204-199c255d267e'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:44 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:55:44 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:44 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3080a916-54d7-4b1a-b94d-23e76ab615ef" returned: 0 in 1.023s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:55:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782f3e73-50b3-49e6-b6cd-6113fa9d5baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3080a916-54d7-4b1a-b94d-23e76ab615ef', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf21d0b-09ce-4697-bafb-a37f4e068293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:45 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Volume volume-3080a916-54d7-4b1a-b94d-23e76ab615ef (3080a916-54d7-4b1a-b94d-23e76ab615ef): created successfully Jul 03 23:55:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf21d0b-09ce-4697-bafb-a37f4e068293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Flow 'volume_create_manager' (a776dccf-f082-4b13-bb52-3590ceab2bd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:45 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3fc9b162-3ded-43c4-9859-b0516966cb00 tempest-VolumesTestJSON-177249583 None] Created volume successfully. Jul 03 23:55:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ee30357-9417-4f72-ad93-fe6be2dbb00c tempest-GroupSnapshotsV319Test-310047884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ee30357-9417-4f72-ad93-fe6be2dbb00c tempest-GroupSnapshotsV319Test-310047884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9ee30357-9417-4f72-ad93-fe6be2dbb00c tempest-GroupSnapshotsV319Test-310047884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9ee30357-9417-4f72-ad93-fe6be2dbb00c tempest-GroupSnapshotsV319Test-310047884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ee30357-9417-4f72-ad93-fe6be2dbb00c tempest-GroupSnapshotsV319Test-310047884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ee30357-9417-4f72-ad93-fe6be2dbb00c tempest-GroupSnapshotsV319Test-310047884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:45 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:55:45 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:45 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.753s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:45 devstack cinder-volume[86676]: DEBUG cinder.manager [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:55:45 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] Deleted volume successfully. Jul 03 23:55:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-dbc9e1eb-0c1e-4111-b68c-8cc63e627bc2 req-d4c6b749-2f62-418e-a6de-f2781b044f06 tempest-VolumesGetTestJSON-1308791173 None] Lock "cinder-6d42b603-b90d-4c13-8b23-6c44b6065291-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:46 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ee30357-9417-4f72-ad93-fe6be2dbb00c tempest-GroupSnapshotsV319Test-310047884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.980s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9ee30357-9417-4f72-ad93-fe6be2dbb00c tempest-GroupSnapshotsV319Test-310047884 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:55:46 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9ee30357-9417-4f72-ad93-fe6be2dbb00c tempest-GroupSnapshotsV319Test-310047884 None] Delete group completed successfully. Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Flow 'volume_create_manager' (f581a39c-9e5a-46b8-8968-74ab61af651e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891f22f3-8722-4311-980e-f222cec17f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] Acquiring lock "cinder-bf76088f-1da9-4e42-8ec5-05c56c43e8c8-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891f22f3-8722-4311-980e-f222cec17f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-929100344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81931e2a-7b5f-4256-aeed-20b17bd33263,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4ff4db9795e405684f9fe500a103bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:46Z,use_quota=True,user_id='1e497a176be749e6aea06fd94300c691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643e0676-3126-4e4e-a2b0-5eae856077b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643e0676-3126-4e4e-a2b0-5eae856077b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adfb894b-baa5-4c08-951a-7f3f5fa2f07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adfb894b-baa5-4c08-951a-7f3f5fa2f07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81931e2a-7b5f-4256-aeed-20b17bd33263', 'volume_name': 'volume-81931e2a-7b5f-4256-aeed-20b17bd33263', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10aa92a8-e85a-4086-b099-b1287c648ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10aa92a8-e85a-4086-b099-b1287c648ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91895f5b-3873-41f7-b522-ac2f9c3a7d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:46 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Volume 81931e2a-7b5f-4256-aeed-20b17bd33263: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81931e2a-7b5f-4256-aeed-20b17bd33263', 'volume_size': 1} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-929100344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81931e2a-7b5f-4256-aeed-20b17bd33263,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4ff4db9795e405684f9fe500a103bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:46Z,use_quota=True,user_id='1e497a176be749e6aea06fd94300c691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Creating volume 81931e2a-7b5f-4256-aeed-20b17bd33263 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:55:46 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81931e2a-7b5f-4256-aeed-20b17bd33263 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] Lock "cinder-bf76088f-1da9-4e42-8ec5-05c56c43e8c8-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:46 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81931e2a-7b5f-4256-aeed-20b17bd33263 1073741824 Jul 03 23:55:46 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] Acquiring lock "cinder-quobyte-bf76088f-1da9-4e42-8ec5-05c56c43e8c8" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] Lock "cinder-quobyte-bf76088f-1da9-4e42-8ec5-05c56c43e8c8" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7ecb6a-d1d9-470c-a6fa-59dc2334f59e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bf76088f-1da9-4e42-8ec5-05c56c43e8c8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:46 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bf76088f-1da9-4e42-8ec5-05c56c43e8c8 Jul 03 23:55:46 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:47 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bf76088f-1da9-4e42-8ec5-05c56c43e8c8" returned: 0 in 1.054s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bf76088f-1da9-4e42-8ec5-05c56c43e8c8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:47 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bf76088f-1da9-4e42-8ec5-05c56c43e8c8 Jul 03 23:55:47 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:47 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81931e2a-7b5f-4256-aeed-20b17bd33263 1073741824" returned: 0 in 1.218s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81931e2a-7b5f-4256-aeed-20b17bd33263 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:47 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81931e2a-7b5f-4256-aeed-20b17bd33263 Jul 03 23:55:47 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:48 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bf76088f-1da9-4e42-8ec5-05c56c43e8c8" returned: 0 in 0.905s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] Lock "cinder-quobyte-bf76088f-1da9-4e42-8ec5-05c56c43e8c8" released by "delete_volume" :: held 2.020s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:48 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81931e2a-7b5f-4256-aeed-20b17bd33263" returned: 0 in 0.836s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] <== create_volume: return (2131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:55:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.134s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91895f5b-3873-41f7-b522-ac2f9c3a7d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81931e2a-7b5f-4256-aeed-20b17bd33263', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313743aa-a549-4bb3-adde-78bd27b0b9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:48 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Volume volume-81931e2a-7b5f-4256-aeed-20b17bd33263 (81931e2a-7b5f-4256-aeed-20b17bd33263): created successfully Jul 03 23:55:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313743aa-a549-4bb3-adde-78bd27b0b9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Flow 'volume_create_manager' (f581a39c-9e5a-46b8-8968-74ab61af651e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c0b34bb4-33e2-4078-9251-afffe6ce4379 tempest-VolumesTestJSON-177249583 None] Created volume successfully. Jul 03 23:55:48 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] Created reservations ['eb6e3719-7d9a-4d68-98eb-2d3541e5032d', '7898e1db-a9b2-45a6-980c-204a71a0b593', 'b7f2e9e5-95d0-4d7d-8967-e309b0bbe6c5', '0c5de3f6-d21b-4444-b057-b2fde0c59896'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:49 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:55:49 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:49 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.768s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:49 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:55:49 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] Deleted volume successfully. Jul 03 23:55:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a917b514-b09f-496d-9259-64c7e384062d tempest-VolumesTransfersV355Test-1227690477 None] Lock "cinder-bf76088f-1da9-4e42-8ec5-05c56c43e8c8-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Flow 'volume_create_manager' (45de14b4-a567-42b3-8ecd-77652ef6f93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244b82c2-9c04-4ae5-b4ce-2050b6bcf604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244b82c2-9c04-4ae5-b4ce-2050b6bcf604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1787684219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=434d5670-4622-495c-9d3d-8ec4a9e46aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4b7f3ffcc04252923a8b1c5c96337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:51Z,use_quota=True,user_id='a7f7470215504607ab776296c14a9ccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936e2336-41a4-443d-902d-dcfb2649ab63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936e2336-41a4-443d-902d-dcfb2649ab63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770dfe3b-a3c6-44bc-a1d4-86a53bfea393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770dfe3b-a3c6-44bc-a1d4-86a53bfea393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '434d5670-4622-495c-9d3d-8ec4a9e46aea', 'volume_name': 'volume-434d5670-4622-495c-9d3d-8ec4a9e46aea', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5167df-1e32-4666-aa17-4aeb7ecc74d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5167df-1e32-4666-aa17-4aeb7ecc74d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6e3967-48da-4413-b66f-ade6c793ed7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:50 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Volume 434d5670-4622-495c-9d3d-8ec4a9e46aea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-434d5670-4622-495c-9d3d-8ec4a9e46aea', 'volume_size': 1} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1787684219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=434d5670-4622-495c-9d3d-8ec4a9e46aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4b7f3ffcc04252923a8b1c5c96337e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:51Z,use_quota=True,user_id='a7f7470215504607ab776296c14a9ccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Creating volume 434d5670-4622-495c-9d3d-8ec4a9e46aea {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:55:50 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-434d5670-4622-495c-9d3d-8ec4a9e46aea 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:50 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-434d5670-4622-495c-9d3d-8ec4a9e46aea 1073741824 Jul 03 23:55:50 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] Acquiring lock "cinder-81931e2a-7b5f-4256-aeed-20b17bd33263-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] Lock "cinder-81931e2a-7b5f-4256-aeed-20b17bd33263-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] Acquiring lock "cinder-quobyte-81931e2a-7b5f-4256-aeed-20b17bd33263" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] Lock "cinder-quobyte-81931e2a-7b5f-4256-aeed-20b17bd33263" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:51 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b175acbe-12b4-4674-87d8-b337c7c77248]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81931e2a-7b5f-4256-aeed-20b17bd33263 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:51 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81931e2a-7b5f-4256-aeed-20b17bd33263 Jul 03 23:55:51 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:51 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-434d5670-4622-495c-9d3d-8ec4a9e46aea 1073741824" returned: 0 in 1.004s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-434d5670-4622-495c-9d3d-8ec4a9e46aea {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:51 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-434d5670-4622-495c-9d3d-8ec4a9e46aea Jul 03 23:55:51 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5bf4b307-0ed2-4568-be75-f2942f27d7c8 tempest-BackendsCapabilitiesAdminTestsJSON-1480986269 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86676) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Jul 03 23:55:51 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81931e2a-7b5f-4256-aeed-20b17bd33263" returned: 0 in 0.929s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81931e2a-7b5f-4256-aeed-20b17bd33263 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:52 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81931e2a-7b5f-4256-aeed-20b17bd33263 Jul 03 23:55:52 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0803211f-f765-4ed0-9cde-801d49053bf9 tempest-BackendsCapabilitiesAdminTestsJSON-1480986269 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86676) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Jul 03 23:55:52 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-434d5670-4622-495c-9d3d-8ec4a9e46aea" returned: 0 in 0.723s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:55:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6e3967-48da-4413-b66f-ade6c793ed7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-434d5670-4622-495c-9d3d-8ec4a9e46aea', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a590853-7488-45a1-87bd-5961a8c45e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:55:52 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Volume volume-434d5670-4622-495c-9d3d-8ec4a9e46aea (434d5670-4622-495c-9d3d-8ec4a9e46aea): created successfully Jul 03 23:55:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a590853-7488-45a1-87bd-5961a8c45e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:55:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Flow 'volume_create_manager' (45de14b4-a567-42b3-8ecd-77652ef6f93a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:55:52 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-18dafb89-89f2-4c4c-b03b-e1fb54199ba0 tempest-VolumesTransfersV355Test-1752384957 None] Created volume successfully. Jul 03 23:55:52 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-81931e2a-7b5f-4256-aeed-20b17bd33263" returned: 0 in 0.738s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] Lock "cinder-quobyte-81931e2a-7b5f-4256-aeed-20b17bd33263" released by "delete_volume" :: held 1.709s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:52 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] Created reservations ['f6b217c2-ff34-4bb3-af39-a3a34b19ed55', '8cb25356-b1b3-4833-9fa1-703eb396c4b3', '933fce7d-c4f5-4dfd-ad58-4dbf6bb5a4e6', '80ec227c-bf3b-4d08-aa27-3ab9a6f21747'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:52 devstack sudo[94855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:55:52 devstack sudo[94855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] Acquiring lock "cinder-434d5670-4622-495c-9d3d-8ec4a9e46aea-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] Lock "cinder-434d5670-4622-495c-9d3d-8ec4a9e46aea-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] Acquiring lock "cinder-3080a916-54d7-4b1a-b94d-23e76ab615ef-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] Lock "cinder-3080a916-54d7-4b1a-b94d-23e76ab615ef-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] Acquiring lock "cinder-quobyte-434d5670-4622-495c-9d3d-8ec4a9e46aea" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] Acquiring lock "cinder-quobyte-3080a916-54d7-4b1a-b94d-23e76ab615ef" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] Lock "cinder-quobyte-434d5670-4622-495c-9d3d-8ec4a9e46aea" acquired by "delete_volume" :: waited 0.037s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] Lock "cinder-quobyte-3080a916-54d7-4b1a-b94d-23e76ab615ef" acquired by "delete_volume" :: waited 0.050s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3db754b-aa0b-4f37-8adb-8ad69e02c156]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-434d5670-4622-495c-9d3d-8ec4a9e46aea {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8779ce97-4d38-4a19-a72d-5c8ecc8328b8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3080a916-54d7-4b1a-b94d-23e76ab615ef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:53 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-434d5670-4622-495c-9d3d-8ec4a9e46aea Jul 03 23:55:53 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:53 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3080a916-54d7-4b1a-b94d-23e76ab615ef Jul 03 23:55:53 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:53 devstack sudo[94855]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.998s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:55:53 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] Deleted volume successfully. Jul 03 23:55:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a61da0d7-0572-45a5-bc85-3f51a8ea6327 tempest-VolumesTestJSON-177249583 None] Lock "cinder-81931e2a-7b5f-4256-aeed-20b17bd33263-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:54 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3080a916-54d7-4b1a-b94d-23e76ab615ef" returned: 0 in 1.137s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3080a916-54d7-4b1a-b94d-23e76ab615ef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:54 devstack sudo[94869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3080a916-54d7-4b1a-b94d-23e76ab615ef Jul 03 23:55:54 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:54 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-434d5670-4622-495c-9d3d-8ec4a9e46aea" returned: 0 in 1.260s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-434d5670-4622-495c-9d3d-8ec4a9e46aea {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:54 devstack sudo[94871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-434d5670-4622-495c-9d3d-8ec4a9e46aea Jul 03 23:55:54 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:55 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3080a916-54d7-4b1a-b94d-23e76ab615ef" returned: 0 in 0.917s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] Lock "cinder-quobyte-3080a916-54d7-4b1a-b94d-23e76ab615ef" released by "delete_volume" :: held 2.112s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:55 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=202,cinder:SELECT=170,cinder:INSERT=51,cinder:DELETE=15 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:55:55 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=157,cinder:DELETE=13,cinder:UPDATE=217,cinder:INSERT=48 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:55:55 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] Created reservations ['f74df565-2c81-402c-9ddc-9fdc32b34f62', '5a6284a0-9bc9-4372-9188-ee7e708129e5', 'af7760cc-68c2-4a95-a420-767ab6f9ffc9', 'b29dc8fc-86c8-4fd0-a2b3-8f9476caf797'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:55 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-434d5670-4622-495c-9d3d-8ec4a9e46aea" returned: 0 in 1.080s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:55 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:55:55 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] Lock "cinder-quobyte-434d5670-4622-495c-9d3d-8ec4a9e46aea" released by "delete_volume" :: held 2.422s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:55 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] Created reservations ['98a206d0-cc21-459c-a866-e320f2fe8c37', '94106b5b-81e9-4e87-8ade-99e2d09b6094', '24a7eb32-0bdb-44db-aeda-82109a753e7f', 'eca15868-0a85-427c-a31d-6954fe160aba'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:56 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:55:56 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:56 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.998s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:56 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:55:56 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] Deleted volume successfully. Jul 03 23:55:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] Acquiring lock "cinder-d7976adb-d502-4d88-8142-4358477f8f80-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] Lock "cinder-d7976adb-d502-4d88-8142-4358477f8f80-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ac636947-dab9-47cb-8390-9dca2b9db9a5 tempest-VolumesTestJSON-177249583 None] Lock "cinder-3080a916-54d7-4b1a-b94d-23e76ab615ef-delete_volume" released by "delete_volume" :: held 3.560s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:56 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.924s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:56 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:55:56 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] Deleted volume successfully. Jul 03 23:55:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] Acquiring lock "cinder-quobyte-d7976adb-d502-4d88-8142-4358477f8f80" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:55:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a9431cdd-b50e-4f57-81ad-27efc14b9251 tempest-VolumesTransfersV355Test-1227690477 None] Lock "cinder-434d5670-4622-495c-9d3d-8ec4a9e46aea-delete_volume" released by "delete_volume" :: held 3.721s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] Lock "cinder-quobyte-d7976adb-d502-4d88-8142-4358477f8f80" acquired by "delete_volume" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:55:57 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9808c362-f0b3-41ea-a377-7ad01cb8b42a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:55:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d7976adb-d502-4d88-8142-4358477f8f80 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:57 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d7976adb-d502-4d88-8142-4358477f8f80 Jul 03 23:55:57 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:58 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d7976adb-d502-4d88-8142-4358477f8f80" returned: 0 in 0.952s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d7976adb-d502-4d88-8142-4358477f8f80 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:58 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d7976adb-d502-4d88-8142-4358477f8f80 Jul 03 23:55:58 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:58 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d7976adb-d502-4d88-8142-4358477f8f80" returned: 0 in 0.784s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] Lock "cinder-quobyte-d7976adb-d502-4d88-8142-4358477f8f80" released by "delete_volume" :: held 1.822s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:55:58 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] Created reservations ['f47d9022-780a-4f3d-bb57-6558df4017f0', 'a11c13fa-1c20-4dfd-b83e-3d5c931f1a34', 'e96593dd-36b9-4834-9ee8-e8ca8f1648f1', 'a8603d68-91a8-4249-8811-073964a1e3c9'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:55:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:55:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:55:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:55:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:55:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:55:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:55:59 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:55:59 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:55:59 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Jul 03 23:55:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.772s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:55:59 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:55:59 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] Deleted volume successfully. Jul 03 23:55:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dfbc4358-278f-4a58-ac3c-8e28496d408f tempest-VolumesTestJSON-177249583 None] Lock "cinder-d7976adb-d502-4d88-8142-4358477f8f80-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:56:02 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b69fdfc5-d08b-48a9-9a48-5267746a3b28 tempest-GroupsV320Test-1464071734 None] Group tempest-GroupsV320Test-Group-2109902365: creating Jul 03 23:56:02 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b69fdfc5-d08b-48a9-9a48-5267746a3b28 tempest-GroupsV320Test-1464071734 None] Group tempest-GroupsV320Test-Group-2109902365: created successfully Jul 03 23:56:02 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b69fdfc5-d08b-48a9-9a48-5267746a3b28 tempest-GroupsV320Test-1464071734 None] Create group completed successfully. Jul 03 23:56:03 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-baca96de-0d38-44e1-bdce-4ac6b440cbf4 tempest-GroupsV320Test-1464071734 None] Created reservations ['5842105b-fe4c-431a-96fc-ce679e8b1f0a'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:56:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-baca96de-0d38-44e1-bdce-4ac6b440cbf4 tempest-GroupsV320Test-1464071734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-baca96de-0d38-44e1-bdce-4ac6b440cbf4 tempest-GroupsV320Test-1464071734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-baca96de-0d38-44e1-bdce-4ac6b440cbf4 tempest-GroupsV320Test-1464071734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:56:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-baca96de-0d38-44e1-bdce-4ac6b440cbf4 tempest-GroupsV320Test-1464071734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:56:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-baca96de-0d38-44e1-bdce-4ac6b440cbf4 tempest-GroupsV320Test-1464071734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-baca96de-0d38-44e1-bdce-4ac6b440cbf4 tempest-GroupsV320Test-1464071734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:04 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:56:04 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:04 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-baca96de-0d38-44e1-bdce-4ac6b440cbf4 tempest-GroupsV320Test-1464071734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.765s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:04 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-baca96de-0d38-44e1-bdce-4ac6b440cbf4 tempest-GroupsV320Test-1464071734 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:56:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-baca96de-0d38-44e1-bdce-4ac6b440cbf4 tempest-GroupsV320Test-1464071734 None] Delete group completed successfully. Jul 03 23:56:06 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c7a749b2-e9ae-4c3b-8c41-24457d200b6d tempest-GroupsV314Test-1168054290 None] Group tempest-GroupsV314Test-Group-988885926: creating Jul 03 23:56:06 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c7a749b2-e9ae-4c3b-8c41-24457d200b6d tempest-GroupsV314Test-1168054290 None] Group tempest-GroupsV314Test-Group-988885926: created successfully Jul 03 23:56:06 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c7a749b2-e9ae-4c3b-8c41-24457d200b6d tempest-GroupsV314Test-1168054290 None] Create group completed successfully. Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Flow 'volume_create_manager' (8ace281d-42a3-4733-8e05-1f412bd97264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51cfad6-2af3-4372-9915-d1e1c0216c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51cfad6-2af3-4372-9915-d1e1c0216c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-331984893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4875d6-133c-4d1f-86da-1d661384675b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13835017a5aa4c279dd8aa79d37eda62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:08Z,use_quota=True,user_id='6780a5ff31ab433983fe978235b99dc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb89434-20f9-4091-b8fa-0f7cd5e54a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb89434-20f9-4091-b8fa-0f7cd5e54a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c030b7-98e0-4bb4-a0a4-42639964cce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c030b7-98e0-4bb4-a0a4-42639964cce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd4875d6-133c-4d1f-86da-1d661384675b', 'volume_name': 'volume-fd4875d6-133c-4d1f-86da-1d661384675b', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c1a516-8144-4a41-928e-6f787d934cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c1a516-8144-4a41-928e-6f787d934cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb51230-5e2d-4580-9b17-2e0420d76a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:07 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Volume fd4875d6-133c-4d1f-86da-1d661384675b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd4875d6-133c-4d1f-86da-1d661384675b', 'volume_size': 1} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-331984893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4875d6-133c-4d1f-86da-1d661384675b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13835017a5aa4c279dd8aa79d37eda62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:08Z,use_quota=True,user_id='6780a5ff31ab433983fe978235b99dc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Creating volume fd4875d6-133c-4d1f-86da-1d661384675b {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:56:07 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:56:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fd4875d6-133c-4d1f-86da-1d661384675b 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:07 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fd4875d6-133c-4d1f-86da-1d661384675b 1073741824 Jul 03 23:56:07 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:08 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:56:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Flow 'volume_create_manager' (3bcddd16-43ad-4e3f-9dcc-b96a079843e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:56:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af886863-4203-4a76-ae17-e8bbdb62e8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af886863-4203-4a76-ae17-e8bbdb62e8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-425892307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15ceac44-969d-4fbf-ae1a-da89022c3850,host='devstack@QuobyteHD#QuobyteHD',id=a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e692d6365b344f5c9f90be4c41829ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:08Z,use_quota=True,user_id='d831bf2ba79945d9bf6ab5c442499e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44608625-40c6-4d1a-afcd-615d70fa8c81),volume_type_id=44608625-40c6-4d1a-afcd-615d70fa8c81)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db0190d-24da-443e-8a6c-ce55b5aa0884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db0190d-24da-443e-8a6c-ce55b5aa0884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44257ed8-e1f0-4dcf-9bdf-68ab3310fe6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44257ed8-e1f0-4dcf-9bdf-68ab3310fe6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6', 'volume_name': 'volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e99661-70d2-4cac-9169-a69934f0ae41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e99661-70d2-4cac-9169-a69934f0ae41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5430692-cbbb-44af-9da8-1598f89e301f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:08 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Volume a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6', 'volume_size': 1} Jul 03 23:56:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:09 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fd4875d6-133c-4d1f-86da-1d661384675b 1073741824" returned: 0 in 1.209s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fd4875d6-133c-4d1f-86da-1d661384675b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:09 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fd4875d6-133c-4d1f-86da-1d661384675b Jul 03 23:56:09 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-164a21fc-b80d-4150-8d38-49765ce0b6ed tempest-GroupsTest-746959068 None] Group tempest-Group1-525825486: creating Jul 03 23:56:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-164a21fc-b80d-4150-8d38-49765ce0b6ed tempest-GroupsTest-746959068 None] Group tempest-Group1-525825486: created successfully Jul 03 23:56:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-164a21fc-b80d-4150-8d38-49765ce0b6ed tempest-GroupsTest-746959068 None] Create group completed successfully. Jul 03 23:56:09 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fd4875d6-133c-4d1f-86da-1d661384675b" returned: 0 in 0.756s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] <== create_volume: return (2018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:56:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.488s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=15ceac44-969d-4fbf-ae1a-da89022c3850,created_at=2026-07-03T21:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-425892307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15ceac44-969d-4fbf-ae1a-da89022c3850,host='devstack@QuobyteHD#QuobyteHD',id=a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e692d6365b344f5c9f90be4c41829ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:08Z,use_quota=True,user_id='d831bf2ba79945d9bf6ab5c442499e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44608625-40c6-4d1a-afcd-615d70fa8c81),volume_type_id=44608625-40c6-4d1a-afcd-615d70fa8c81)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:56:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Creating volume a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:56:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:56:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:56:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:56:09 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:56:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:09 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 1073741824 Jul 03 23:56:09 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb51230-5e2d-4580-9b17-2e0420d76a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd4875d6-133c-4d1f-86da-1d661384675b', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c8abe1-c708-42f5-807f-b38ad36f04ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:09 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Volume volume-fd4875d6-133c-4d1f-86da-1d661384675b (fd4875d6-133c-4d1f-86da-1d661384675b): created successfully Jul 03 23:56:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c8abe1-c708-42f5-807f-b38ad36f04ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Flow 'volume_create_manager' (8ace281d-42a3-4733-8e05-1f412bd97264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:56:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0f9a44c3-0197-413d-b2c3-3086fd1a03b6 tempest-VolumesTransfersV357Test-1842473512 None] Created volume successfully. Jul 03 23:56:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d1805024-378a-465f-9350-ca8314b2b831 tempest-GroupsTest-746959068 None] Group tempest-Group2-1973255484: creating Jul 03 23:56:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d1805024-378a-465f-9350-ca8314b2b831 tempest-GroupsTest-746959068 None] Group tempest-Group2-1973255484: created successfully Jul 03 23:56:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d1805024-378a-465f-9350-ca8314b2b831 tempest-GroupsTest-746959068 None] Create group completed successfully. Jul 03 23:56:10 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 1073741824" returned: 0 in 0.926s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:10 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 Jul 03 23:56:10 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:11 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6" returned: 0 in 0.729s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:56:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5430692-cbbb-44af-9da8-1598f89e301f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5057e9d7-0156-45b3-88b2-141805d64b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:11 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Volume volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 (a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6): created successfully Jul 03 23:56:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5057e9d7-0156-45b3-88b2-141805d64b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Flow 'volume_create_manager' (3bcddd16-43ad-4e3f-9dcc-b96a079843e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:56:11 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0889a67d-c441-48c6-8a6f-8a996f3d5f62 tempest-GroupsV314Test-1168054290 None] Created volume successfully. Jul 03 23:56:11 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d3f9f7e5-b990-4b24-bc09-d26e713ce48d tempest-VolumesTransfersV357Test-337404475 None] Transfer volume completed successfully. Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Flow 'volume_create_manager' (8dd0e0be-9f1a-487b-ba1d-827d04484107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba62561-9116-4be6-b15e-41861f303ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba62561-9116-4be6-b15e-41861f303ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1207205989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=81af7148-3f22-4f72-9b48-42dd1cb1e3d8,host='devstack@QuobyteHD#QuobyteHD',id=c69e3f81-685f-4afb-9318-5369fe98d1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='455261b67a1e4cfdbe7124b50f7a0de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:13Z,use_quota=True,user_id='e5876244ce6940a3b4e49010006b411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee26926a-efa4-4a96-b351-a05cd1ec7ced),volume_type_id=ee26926a-efa4-4a96-b351-a05cd1ec7ced)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0287aaff-4f42-4dc3-aec9-eac258376b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0287aaff-4f42-4dc3-aec9-eac258376b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4819bbaf-49bd-45c5-b805-bec9162a4e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4819bbaf-49bd-45c5-b805-bec9162a4e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c69e3f81-685f-4afb-9318-5369fe98d1ff', 'volume_name': 'volume-c69e3f81-685f-4afb-9318-5369fe98d1ff', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40719b5f-9919-4745-8df5-d808af40e7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40719b5f-9919-4745-8df5-d808af40e7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c286d0e-4980-4a32-b292-097003fd8562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:12 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Volume c69e3f81-685f-4afb-9318-5369fe98d1ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c69e3f81-685f-4afb-9318-5369fe98d1ff', 'volume_size': 1} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=81af7148-3f22-4f72-9b48-42dd1cb1e3d8,created_at=2026-07-03T21:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1207205989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=81af7148-3f22-4f72-9b48-42dd1cb1e3d8,host='devstack@QuobyteHD#QuobyteHD',id=c69e3f81-685f-4afb-9318-5369fe98d1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='455261b67a1e4cfdbe7124b50f7a0de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:13Z,use_quota=True,user_id='e5876244ce6940a3b4e49010006b411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee26926a-efa4-4a96-b351-a05cd1ec7ced),volume_type_id=ee26926a-efa4-4a96-b351-a05cd1ec7ced)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Creating volume c69e3f81-685f-4afb-9318-5369fe98d1ff {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:56:12 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:56:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c69e3f81-685f-4afb-9318-5369fe98d1ff 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:12 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c69e3f81-685f-4afb-9318-5369fe98d1ff 1073741824 Jul 03 23:56:12 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] Acquiring lock "cinder-fd4875d6-133c-4d1f-86da-1d661384675b-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:56:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] Lock "cinder-fd4875d6-133c-4d1f-86da-1d661384675b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:56:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] Acquiring lock "cinder-quobyte-fd4875d6-133c-4d1f-86da-1d661384675b" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:56:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] Lock "cinder-quobyte-fd4875d6-133c-4d1f-86da-1d661384675b" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:56:13 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[251d7b71-95b5-484e-869e-018bba74719d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:56:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fd4875d6-133c-4d1f-86da-1d661384675b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:13 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fd4875d6-133c-4d1f-86da-1d661384675b Jul 03 23:56:13 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:13 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c69e3f81-685f-4afb-9318-5369fe98d1ff 1073741824" returned: 0 in 1.101s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c69e3f81-685f-4afb-9318-5369fe98d1ff {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:13 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c69e3f81-685f-4afb-9318-5369fe98d1ff Jul 03 23:56:13 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:14 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fd4875d6-133c-4d1f-86da-1d661384675b" returned: 0 in 0.979s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fd4875d6-133c-4d1f-86da-1d661384675b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:14 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fd4875d6-133c-4d1f-86da-1d661384675b Jul 03 23:56:14 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:14 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c69e3f81-685f-4afb-9318-5369fe98d1ff" returned: 0 in 0.866s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:56:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.404s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:14 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Cloning volume a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 to volume 5ce20d01-0bdc-4111-8b44-6cce5eb4566b Jul 03 23:56:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c286d0e-4980-4a32-b292-097003fd8562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c69e3f81-685f-4afb-9318-5369fe98d1ff', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e07c8fb7-69ff-4e20-ad37-f5556632363e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Creating offline snapshot 50be876c-8578-4c73-abe3-12700593322a of volume a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 23:56:14 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Volume volume-c69e3f81-685f-4afb-9318-5369fe98d1ff (c69e3f81-685f-4afb-9318-5369fe98d1ff): created successfully Jul 03 23:56:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e07c8fb7-69ff-4e20-ad37-f5556632363e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Flow 'volume_create_manager' (8dd0e0be-9f1a-487b-ba1d-827d04484107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:56:14 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1f8ba9-1dd0-485a-a321-16624ccf4248]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:56:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:14 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e4665a0b-e77c-49b5-9dbb-943d9b732b74 tempest-GroupsTest-746959068 None] Created volume successfully. Jul 03 23:56:15 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 Jul 03 23:56:15 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:15 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fd4875d6-133c-4d1f-86da-1d661384675b" returned: 0 in 0.870s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] Lock "cinder-quobyte-fd4875d6-133c-4d1f-86da-1d661384675b" released by "delete_volume" :: held 1.927s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:56:15 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] Created reservations ['a65cb550-f01f-4884-8f87-9e1aaa7e6f20', 'be8b0d7b-02e6-4ec9-8d34-d3712eaf4e0a', '659a93fe-cc90-48eb-b4bd-62edf4c5cab7', '41f868d7-21a8-4076-bc18-4aaa337633bc'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:56:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:56:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:56:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:15 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:56:15 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] Acquiring lock "cinder-quobyte-c69e3f81-685f-4afb-9318-5369fe98d1ff" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:56:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] Lock "cinder-quobyte-c69e3f81-685f-4afb-9318-5369fe98d1ff" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:56:15 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33fa3a8-fc1b-4c7f-9485-c11b1f543170]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:56:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c69e3f81-685f-4afb-9318-5369fe98d1ff {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:16 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c69e3f81-685f-4afb-9318-5369fe98d1ff Jul 03 23:56:16 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:16 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6" returned: 0 in 1.295s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:16 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a 1G Jul 03 23:56:16 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:16 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:56:16 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Flow 'volume_create_manager' (7b504f7e-ee9d-4897-bb38-5f9022402070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:56:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f651a261-0731-46ee-bae7-dc5c84a886ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.220s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:16 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:56:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] Deleted volume successfully. Jul 03 23:56:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f651a261-0731-46ee-bae7-dc5c84a886ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-629274411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d338514f-1bc7-4e5e-9af4-b350158427c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13835017a5aa4c279dd8aa79d37eda62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:16Z,use_quota=True,user_id='6780a5ff31ab433983fe978235b99dc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b69fb28-b18b-407f-afde-3e553957ba2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b69fb28-b18b-407f-afde-3e553957ba2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d5b3ca-1f7e-4cdb-bac9-b7babb90de07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d5b3ca-1f7e-4cdb-bac9-b7babb90de07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd338514f-1bc7-4e5e-9af4-b350158427c0', 'volume_name': 'volume-d338514f-1bc7-4e5e-9af4-b350158427c0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc079a21-08bb-49ce-b328-6fd5bffb63b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc079a21-08bb-49ce-b328-6fd5bffb63b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3813f8-b8e0-4d86-99d8-4a9da5754b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:16 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Volume d338514f-1bc7-4e5e-9af4-b350158427c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d338514f-1bc7-4e5e-9af4-b350158427c0', 'volume_size': 1} Jul 03 23:56:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-91861be6-eade-4fee-9a8a-86611381046a tempest-VolumesTransfersV357Test-1975326247 None] Lock "cinder-fd4875d6-133c-4d1f-86da-1d661384675b-delete_volume" released by "delete_volume" :: held 3.536s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:56:17 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c69e3f81-685f-4afb-9318-5369fe98d1ff" returned: 0 in 1.226s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c69e3f81-685f-4afb-9318-5369fe98d1ff {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:17 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c69e3f81-685f-4afb-9318-5369fe98d1ff Jul 03 23:56:17 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:17 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a 1G" returned: 0 in 0.995s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:17 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a Jul 03 23:56:17 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:17 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c69e3f81-685f-4afb-9318-5369fe98d1ff" returned: 0 in 0.818s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] Lock "cinder-quobyte-c69e3f81-685f-4afb-9318-5369fe98d1ff" released by "delete_volume" :: held 2.116s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:56:17 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a" returned: 0 in 0.806s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:17 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a is being set with open permissions: ugo+rw: NotImplementedError Jul 03 23:56:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:17 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a Jul 03 23:56:17 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:17 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] Created reservations ['5c45a1f4-ce81-4f47-9e11-32548bb6600d'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:56:17 devstack cinder-volume[86676]: WARNING cinder.quota [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-162202538 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-162202538, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:56:17 devstack cinder-volume[86676]: WARNING cinder.quota [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-162202538 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-162202538, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:56:18 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] Created reservations ['8a9bf775-a74f-4d5e-be4c-7fef380e423a', '706bfab3-05d2-4854-8841-419b91cdc4c4', '76fcb746-6452-4026-8914-3e17c1720d9d', '3395ab62-6525-4fe7-94bf-72af8ab65091'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:56:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:56:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:56:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:18 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:56:18 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:18 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-a62ba3f8-7e38-4f29-88f4-2c81836ec716 tempest-GroupsTest-746959068 None] Created reservations ['7c377d6e-0299-42be-a6ba-922031c3937f'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:56:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a62ba3f8-7e38-4f29-88f4-2c81836ec716 tempest-GroupsTest-746959068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a62ba3f8-7e38-4f29-88f4-2c81836ec716 tempest-GroupsTest-746959068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a62ba3f8-7e38-4f29-88f4-2c81836ec716 tempest-GroupsTest-746959068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:56:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a62ba3f8-7e38-4f29-88f4-2c81836ec716 tempest-GroupsTest-746959068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:56:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a62ba3f8-7e38-4f29-88f4-2c81836ec716 tempest-GroupsTest-746959068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a62ba3f8-7e38-4f29-88f4-2c81836ec716 tempest-GroupsTest-746959068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:18 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:56:18 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:18 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a" returned: 0 in 0.909s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:18 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.info Jul 03 23:56:18 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:19 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.876s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:19 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:56:19 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9b57a614-4f9b-4f48-a18f-0c24e9ecd74c tempest-GroupsTest-746959068 None] Delete group completed successfully. Jul 03 23:56:19 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a62ba3f8-7e38-4f29-88f4-2c81836ec716 tempest-GroupsTest-746959068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.758s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:19 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-a62ba3f8-7e38-4f29-88f4-2c81836ec716 tempest-GroupsTest-746959068 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:56:19 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a62ba3f8-7e38-4f29-88f4-2c81836ec716 tempest-GroupsTest-746959068 None] Delete group completed successfully. Jul 03 23:56:19 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.info" returned: 0 in 0.728s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:19 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 23:56:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:19 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.info Jul 03 23:56:19 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-153dc263-ee1b-4aa5-86b2-aa1be93eaf5d tempest-GroupsTest-746959068 None] Group tempest-GroupsTest-Group-408152816: creating Jul 03 23:56:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-153dc263-ee1b-4aa5-86b2-aa1be93eaf5d tempest-GroupsTest-746959068 None] Group tempest-GroupsTest-Group-408152816: created successfully Jul 03 23:56:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-153dc263-ee1b-4aa5-86b2-aa1be93eaf5d tempest-GroupsTest-746959068 None] Create group completed successfully. Jul 03 23:56:20 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.info" returned: 0 in 0.828s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Acquiring lock "cinder-quobyte-5ce20d01-0bdc-4111-8b44-6cce5eb4566b" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:56:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Lock "cinder-quobyte-5ce20d01-0bdc-4111-8b44-6cce5eb4566b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:56:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] snapshot: 50be876c-8578-4c73-abe3-12700593322a, volume: 5ce20d01-0bdc-4111-8b44-6cce5eb4566b, {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 23:56:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:56:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:56:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:20 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ec0d01-e65b-466e-8b1b-fca157101fe7]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:56:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:20 devstack sudo[94976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a Jul 03 23:56:20 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:21 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a" returned: 0 in 0.868s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:56:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 23:56:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 23:56:21 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3551e7ea-f29f-475b-bef8-cb91664bc43f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:56:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:21 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 Jul 03 23:56:21 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:21 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:56:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Flow 'volume_create_manager' (4b070e51-705e-42eb-90de-e9bf07fa4841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:56:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3352cdc-ec48-41e2-b3e2-53da7f467906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3352cdc-ec48-41e2-b3e2-53da7f467906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1501957113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d58b46f-9048-480e-92d0-b11ead611db4,host='devstack@QuobyteHD#QuobyteHD',id=a7594b2c-7a03-421f-b70f-a6a192c06e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='455261b67a1e4cfdbe7124b50f7a0de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:22Z,use_quota=True,user_id='e5876244ce6940a3b4e49010006b411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12a611ce-6307-4ea2-ad42-e34148abdb45),volume_type_id=12a611ce-6307-4ea2-ad42-e34148abdb45)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfdbf6e-984b-4fec-a0e0-be284a4d3fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfdbf6e-984b-4fec-a0e0-be284a4d3fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e43f893-faf6-4e12-b544-52217e800eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e43f893-faf6-4e12-b544-52217e800eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7594b2c-7a03-421f-b70f-a6a192c06e96', 'volume_name': 'volume-a7594b2c-7a03-421f-b70f-a6a192c06e96', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f282dd-5ba5-4831-818c-19ef1d36fd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f282dd-5ba5-4831-818c-19ef1d36fd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74144121-a14b-4af2-aff8-2a875b52c5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:21 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Volume a7594b2c-7a03-421f-b70f-a6a192c06e96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7594b2c-7a03-421f-b70f-a6a192c06e96', 'volume_size': 1} Jul 03 23:56:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:22 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6" returned: 0 in 1.028s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:22 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Path /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5ce20d01-0bdc-4111-8b44-6cce5eb4566b not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 23:56:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5ce20d01-0bdc-4111-8b44-6cce5eb4566b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:22 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5ce20d01-0bdc-4111-8b44-6cce5eb4566b Jul 03 23:56:22 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:27 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5ce20d01-0bdc-4111-8b44-6cce5eb4566b" returned: 0 in 5.154s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:27 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f9f5a7-0d25-4e68-b8cb-53d69f1b78b9]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:56:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:27 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 Jul 03 23:56:27 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:28 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6" returned: 0 in 0.992s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:28 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6, size 1024.00 MB, duration 5.16 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5ce20d01-0bdc-4111-8b44-6cce5eb4566b {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 23:56:28 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Converted 1024.00 MB image at 198.62 MB/s Jul 03 23:56:28 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5ce20d01-0bdc-4111-8b44-6cce5eb4566b is being set with open permissions: ugo+rw: NotImplementedError Jul 03 23:56:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5ce20d01-0bdc-4111-8b44-6cce5eb4566b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:28 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5ce20d01-0bdc-4111-8b44-6cce5eb4566b Jul 03 23:56:28 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:28 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:56:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Flow 'volume_create_manager' (7f8fa9fd-e943-4826-905b-46b99b1cb404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:56:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a57bb4-60d9-4904-87c0-c379f4aaa205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a57bb4-60d9-4904-87c0-c379f4aaa205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-712265221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da60f8c0-b02a-423e-8ffb-2d4ac51014f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afcb4a80dcf545a3a7c6f422a2878178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:29Z,use_quota=True,user_id='e627e95fbad346d98dadd0de302b77c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e9faa9-7ade-4ce0-8621-fdc9c2b9e37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e9faa9-7ade-4ce0-8621-fdc9c2b9e37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdcbf850-2961-43e5-b465-fe016c960b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdcbf850-2961-43e5-b465-fe016c960b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da60f8c0-b02a-423e-8ffb-2d4ac51014f3', 'volume_name': 'volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0f36ee-a19b-4e69-93e5-6eda6ce87371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0f36ee-a19b-4e69-93e5-6eda6ce87371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a049917-6eee-4184-989e-898d55f1450d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:28 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Volume da60f8c0-b02a-423e-8ffb-2d4ac51014f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3', 'volume_size': 1} Jul 03 23:56:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:29 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5ce20d01-0bdc-4111-8b44-6cce5eb4566b" returned: 0 in 0.649s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Lock "cinder-quobyte-5ce20d01-0bdc-4111-8b44-6cce5eb4566b" released by "_copy_volume_from_snapshot" :: held 8.782s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:56:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Acquiring lock "cinder-quobyte-50be876c-8578-4c73-abe3-12700593322a" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:56:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Lock "cinder-quobyte-50be876c-8578-4c73-abe3-12700593322a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:56:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Deleting offline snapshot 50be876c-8578-4c73-abe3-12700593322a of volume a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 23:56:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] snapshot_file for this snap is: volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 23:56:29 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[819d7b4f-95ac-45fb-9015-473e03819fb7]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:56:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:29 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a Jul 03 23:56:29 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:30 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a" returned: 0 in 0.765s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:56:30 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1733adba-dec9-45a8-9880-25f8332e61b1]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:56:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:30 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 Jul 03 23:56:30 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:30 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6" returned: 0 in 0.795s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:30 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a Jul 03 23:56:30 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:31 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a" returned: 0 in 0.770s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:31 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a Jul 03 23:56:31 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:32 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6.50be876c-8578-4c73-abe3-12700593322a" returned: 0 in 0.670s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Lock "cinder-quobyte-50be876c-8578-4c73-abe3-12700593322a" released by "_delete_snapshot" :: held 3.089s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:56:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.691s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.829s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-629274411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d338514f-1bc7-4e5e-9af4-b350158427c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13835017a5aa4c279dd8aa79d37eda62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:16Z,use_quota=True,user_id='6780a5ff31ab433983fe978235b99dc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:56:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Creating volume d338514f-1bc7-4e5e-9af4-b350158427c0 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:56:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:56:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:56:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:56:32 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:56:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d338514f-1bc7-4e5e-9af4-b350158427c0 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:32 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d338514f-1bc7-4e5e-9af4-b350158427c0 1073741824 Jul 03 23:56:32 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:32 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3b96e321-33b1-42a8-94fd-b0f7171ee3c3 tempest-GroupsV314Test-1168054290 None] Create group from source-group-15ceac44-969d-4fbf-ae1a-da89022c3850 completed successfully. Jul 03 23:56:33 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d338514f-1bc7-4e5e-9af4-b350158427c0 1073741824" returned: 0 in 0.854s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:56:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:56:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:56:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:33 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:56:33 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d338514f-1bc7-4e5e-9af4-b350158427c0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:33 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d338514f-1bc7-4e5e-9af4-b350158427c0 Jul 03 23:56:33 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] Acquiring lock "cinder-quobyte-5ce20d01-0bdc-4111-8b44-6cce5eb4566b" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:56:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] Lock "cinder-quobyte-5ce20d01-0bdc-4111-8b44-6cce5eb4566b" acquired by "delete_volume" :: waited 0.042s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:56:33 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[be20990a-8207-4151-891d-6fd8c2417491]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:56:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5ce20d01-0bdc-4111-8b44-6cce5eb4566b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:34 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5ce20d01-0bdc-4111-8b44-6cce5eb4566b Jul 03 23:56:34 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:34 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d338514f-1bc7-4e5e-9af4-b350158427c0" returned: 0 in 0.799s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.222s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1d58b46f-9048-480e-92d0-b11ead611db4,created_at=2026-07-03T21:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1501957113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d58b46f-9048-480e-92d0-b11ead611db4,host='devstack@QuobyteHD#QuobyteHD',id=a7594b2c-7a03-421f-b70f-a6a192c06e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='455261b67a1e4cfdbe7124b50f7a0de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:22Z,use_quota=True,user_id='e5876244ce6940a3b4e49010006b411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12a611ce-6307-4ea2-ad42-e34148abdb45),volume_type_id=12a611ce-6307-4ea2-ad42-e34148abdb45)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Creating volume a7594b2c-7a03-421f-b70f-a6a192c06e96 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:56:34 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a7594b2c-7a03-421f-b70f-a6a192c06e96 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:34 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a7594b2c-7a03-421f-b70f-a6a192c06e96 1073741824 Jul 03 23:56:34 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3813f8-b8e0-4d86-99d8-4a9da5754b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d338514f-1bc7-4e5e-9af4-b350158427c0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e2df91-2093-4218-943a-71c34e8dc74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:34 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Volume volume-d338514f-1bc7-4e5e-9af4-b350158427c0 (d338514f-1bc7-4e5e-9af4-b350158427c0): created successfully Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e2df91-2093-4218-943a-71c34e8dc74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Flow 'volume_create_manager' (7b504f7e-ee9d-4897-bb38-5f9022402070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:56:34 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.963s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 8 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 03 23:56:34 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-082016a5-f693-447d-800f-1be98ad641f2 tempest-VolumesTransfersV357Test-1842473512 None] Created volume successfully. Jul 03 23:56:34 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5ce20d01-0bdc-4111-8b44-6cce5eb4566b" returned: 0 in 0.932s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5ce20d01-0bdc-4111-8b44-6cce5eb4566b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:34 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5ce20d01-0bdc-4111-8b44-6cce5eb4566b Jul 03 23:56:34 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:35 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a7594b2c-7a03-421f-b70f-a6a192c06e96 1073741824" returned: 0 in 1.054s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a7594b2c-7a03-421f-b70f-a6a192c06e96 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:35 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a7594b2c-7a03-421f-b70f-a6a192c06e96 Jul 03 23:56:35 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] Acquiring lock "cinder-d338514f-1bc7-4e5e-9af4-b350158427c0-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:56:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] Lock "cinder-d338514f-1bc7-4e5e-9af4-b350158427c0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:56:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] Acquiring lock "cinder-quobyte-d338514f-1bc7-4e5e-9af4-b350158427c0" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:56:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] Lock "cinder-quobyte-d338514f-1bc7-4e5e-9af4-b350158427c0" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:56:35 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[80611c6f-3a82-4eec-9c1a-21b01f44b0f4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:56:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d338514f-1bc7-4e5e-9af4-b350158427c0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:35 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d338514f-1bc7-4e5e-9af4-b350158427c0 Jul 03 23:56:35 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:35 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5ce20d01-0bdc-4111-8b44-6cce5eb4566b" returned: 0 in 0.895s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] Lock "cinder-quobyte-5ce20d01-0bdc-4111-8b44-6cce5eb4566b" released by "delete_volume" :: held 1.916s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:56:35 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] Created reservations ['8500922f-4335-488e-b2da-106f9dfdf15b'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:56:35 devstack cinder-volume[86676]: WARNING cinder.quota [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-268064064 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-268064064, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:56:35 devstack cinder-volume[86676]: WARNING cinder.quota [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-268064064 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-268064064, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:56:35 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] Created reservations ['f2ee5d43-4659-4d39-bba1-f19fadb7a2b8', '448ea720-9896-4f3c-9e65-24e6f0d52040', 'ea879eff-cad1-4bde-b58d-79580412db75', 'e7058cc9-ef25-448a-a0b0-6be370ee0d05'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:56:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:36 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a7594b2c-7a03-421f-b70f-a6a192c06e96" returned: 0 in 0.757s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:36 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:56:36 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.117s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-712265221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da60f8c0-b02a-423e-8ffb-2d4ac51014f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afcb4a80dcf545a3a7c6f422a2878178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:29Z,use_quota=True,user_id='e627e95fbad346d98dadd0de302b77c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Creating volume da60f8c0-b02a-423e-8ffb-2d4ac51014f3 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:56:36 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74144121-a14b-4af2-aff8-2a875b52c5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7594b2c-7a03-421f-b70f-a6a192c06e96', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:36 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3 1073741824 Jul 03 23:56:36 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34de9ffb-4f52-47cb-8a8c-885e74cd6b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:36 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Volume volume-a7594b2c-7a03-421f-b70f-a6a192c06e96 (a7594b2c-7a03-421f-b70f-a6a192c06e96): created successfully Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34de9ffb-4f52-47cb-8a8c-885e74cd6b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Flow 'volume_create_manager' (4b070e51-705e-42eb-90de-e9bf07fa4841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:56:36 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-de220f68-aebc-4c50-9546-43b14ca874fd tempest-GroupsTest-746959068 None] Created volume successfully. Jul 03 23:56:36 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d338514f-1bc7-4e5e-9af4-b350158427c0" returned: 0 in 0.956s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d338514f-1bc7-4e5e-9af4-b350158427c0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:36 devstack sudo[95102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d338514f-1bc7-4e5e-9af4-b350158427c0 Jul 03 23:56:36 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c44eedd1-27ad-4025-9ec1-ed8cf74636e6 tempest-GroupsV314Test-1168054290 None] Acquiring lock "cinder-quobyte-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c44eedd1-27ad-4025-9ec1-ed8cf74636e6 tempest-GroupsV314Test-1168054290 None] Lock "cinder-quobyte-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6" acquired by "delete_volume" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[371918ac-0bcb-4c3d-8c9a-804572239945]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c44eedd1-27ad-4025-9ec1-ed8cf74636e6 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:36 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.934s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:36 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:56:36 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 Jul 03 23:56:36 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:36 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f4ea232e-58a5-4404-9bbf-4b84056f8208 tempest-GroupsV314Test-1168054290 None] Delete group completed successfully. Jul 03 23:56:37 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3 1073741824" returned: 0 in 1.350s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Flow 'volume_create_manager' (7233a5d9-632b-4a80-adf5-9e4ecc4a5e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:56:37 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f5d5da-9085-43a1-a718-5584bba195de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d338514f-1bc7-4e5e-9af4-b350158427c0" returned: 0 in 0.990s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:37 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3 Jul 03 23:56:37 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f5d5da-9085-43a1-a718-5584bba195de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1471572836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d58b46f-9048-480e-92d0-b11ead611db4,host='devstack@QuobyteHD#QuobyteHD',id=f15cf8af-579e-4780-aee0-e5b706e13c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='455261b67a1e4cfdbe7124b50f7a0de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:37Z,use_quota=True,user_id='e5876244ce6940a3b4e49010006b411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12a611ce-6307-4ea2-ad42-e34148abdb45),volume_type_id=12a611ce-6307-4ea2-ad42-e34148abdb45)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865043eb-f2ab-4adc-ba74-ee1a66f959c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865043eb-f2ab-4adc-ba74-ee1a66f959c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8860999-2493-4594-aa5f-b3037f1d18d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8860999-2493-4594-aa5f-b3037f1d18d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f15cf8af-579e-4780-aee0-e5b706e13c3e', 'volume_name': 'volume-f15cf8af-579e-4780-aee0-e5b706e13c3e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc024da8-3fbc-4a43-9a9d-3ec1aa9d2f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc024da8-3fbc-4a43-9a9d-3ec1aa9d2f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca8f958-a349-46ec-8f5f-eed14ad12a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:37 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Volume f15cf8af-579e-4780-aee0-e5b706e13c3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f15cf8af-579e-4780-aee0-e5b706e13c3e', 'volume_size': 1} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] Lock "cinder-quobyte-d338514f-1bc7-4e5e-9af4-b350158427c0" released by "delete_volume" :: held 2.067s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] Created reservations ['a866fa39-aa8e-4b8b-9b03-69b12dd5a5e6', '8c727959-c037-474c-a22b-1fcb1df0f2ed', '1dee56c1-ebed-4d9e-ab82-4a7bd68a9719', '5ce8d3b3-7673-4564-8d5d-7baabf368a5c'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:37 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:56:37 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:37 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c44eedd1-27ad-4025-9ec1-ed8cf74636e6 tempest-GroupsV314Test-1168054290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6" returned: 0 in 1.102s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c44eedd1-27ad-4025-9ec1-ed8cf74636e6 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:37 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6 Jul 03 23:56:37 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:38 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3" returned: 0 in 0.842s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] <== create_volume: return (2331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.338s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.778s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1d58b46f-9048-480e-92d0-b11ead611db4,created_at=2026-07-03T21:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1471572836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d58b46f-9048-480e-92d0-b11ead611db4,host='devstack@QuobyteHD#QuobyteHD',id=f15cf8af-579e-4780-aee0-e5b706e13c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='455261b67a1e4cfdbe7124b50f7a0de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:37Z,use_quota=True,user_id='e5876244ce6940a3b4e49010006b411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12a611ce-6307-4ea2-ad42-e34148abdb45),volume_type_id=12a611ce-6307-4ea2-ad42-e34148abdb45)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Creating volume f15cf8af-579e-4780-aee0-e5b706e13c3e {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:56:38 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f15cf8af-579e-4780-aee0-e5b706e13c3e 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:38 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f15cf8af-579e-4780-aee0-e5b706e13c3e 1073741824 Jul 03 23:56:38 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a049917-6eee-4184-989e-898d55f1450d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54416a31-43b1-42d4-bb31-56ed2bd217aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Volume volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3 (da60f8c0-b02a-423e-8ffb-2d4ac51014f3): created successfully Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54416a31-43b1-42d4-bb31-56ed2bd217aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Flow 'volume_create_manager' (7f8fa9fd-e943-4826-905b-46b99b1cb404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:56:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1ae42ea6-452a-473e-9660-b48a90988b08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Created volume successfully. Jul 03 23:56:38 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.902s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:56:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] Deleted volume successfully. Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d82d6b32-773d-4d58-b980-345d750c97f4 tempest-VolumesTransfersV357Test-1975326247 None] Lock "cinder-d338514f-1bc7-4e5e-9af4-b350158427c0-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:56:38 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c44eedd1-27ad-4025-9ec1-ed8cf74636e6 tempest-GroupsV314Test-1168054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6" returned: 0 in 0.973s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c44eedd1-27ad-4025-9ec1-ed8cf74636e6 tempest-GroupsV314Test-1168054290 None] Lock "cinder-quobyte-a65fe4d6-7bf8-4adc-8873-cdbe6455d1d6" released by "delete_volume" :: held 2.197s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:56:38 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-c44eedd1-27ad-4025-9ec1-ed8cf74636e6 tempest-GroupsV314Test-1168054290 None] Created reservations ['0f58e7bd-1128-4f4c-83ff-a6b277fd05ec'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:56:39 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-c44eedd1-27ad-4025-9ec1-ed8cf74636e6 tempest-GroupsV314Test-1168054290 None] Created reservations ['94747a71-094c-4bdf-ae2a-c33adf0726a2', 'a11f8752-251a-4ffb-a998-904de83e62f6', 'cb513004-bfec-4ecf-a20a-52e53535d13c', '5e2b6350-4a16-45ec-abbf-67cfe1c8d7e9'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:56:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c44eedd1-27ad-4025-9ec1-ed8cf74636e6 tempest-GroupsV314Test-1168054290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c44eedd1-27ad-4025-9ec1-ed8cf74636e6 tempest-GroupsV314Test-1168054290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c44eedd1-27ad-4025-9ec1-ed8cf74636e6 tempest-GroupsV314Test-1168054290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:56:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c44eedd1-27ad-4025-9ec1-ed8cf74636e6 tempest-GroupsV314Test-1168054290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:56:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c44eedd1-27ad-4025-9ec1-ed8cf74636e6 tempest-GroupsV314Test-1168054290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c44eedd1-27ad-4025-9ec1-ed8cf74636e6 tempest-GroupsV314Test-1168054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:39 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:56:39 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:39 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f15cf8af-579e-4780-aee0-e5b706e13c3e 1073741824" returned: 0 in 1.258s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f15cf8af-579e-4780-aee0-e5b706e13c3e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:39 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f15cf8af-579e-4780-aee0-e5b706e13c3e Jul 03 23:56:39 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4f8013aa-549c-4a8f-842c-bc4ff7c4eb33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:40 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c44eedd1-27ad-4025-9ec1-ed8cf74636e6 tempest-GroupsV314Test-1168054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.882s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:40 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-c44eedd1-27ad-4025-9ec1-ed8cf74636e6 tempest-GroupsV314Test-1168054290 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:56:40 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c44eedd1-27ad-4025-9ec1-ed8cf74636e6 tempest-GroupsV314Test-1168054290 None] Delete group completed successfully. Jul 03 23:56:40 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f15cf8af-579e-4780-aee0-e5b706e13c3e" returned: 0 in 0.941s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] <== create_volume: return (2295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:56:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.301s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4f8013aa-549c-4a8f-842c-bc4ff7c4eb33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.722s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-4f8013aa-549c-4a8f-842c-bc4ff7c4eb33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Creating offline snapshot 7de0b390-9581-4148-9006-fabf43338bd1 of volume da60f8c0-b02a-423e-8ffb-2d4ac51014f3 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 23:56:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca8f958-a349-46ec-8f5f-eed14ad12a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15cf8af-579e-4780-aee0-e5b706e13c3e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a26e25-1547-4803-ae0f-880974e2ba01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:40 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d12579-e624-4ea2-bc3f-0a457082ea60]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:56:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4f8013aa-549c-4a8f-842c-bc4ff7c4eb33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:40 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Volume volume-f15cf8af-579e-4780-aee0-e5b706e13c3e (f15cf8af-579e-4780-aee0-e5b706e13c3e): created successfully Jul 03 23:56:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a26e25-1547-4803-ae0f-880974e2ba01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Flow 'volume_create_manager' (7233a5d9-632b-4a80-adf5-9e4ecc4a5e7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:56:40 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b85a698d-4470-4670-85d1-969ee314db14 tempest-GroupsTest-746959068 None] Created volume successfully. Jul 03 23:56:40 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3 Jul 03 23:56:40 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:41 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5df345e4-b267-4e2d-ac73-8502f0a4284b tempest-GroupsTest-746959068 None] Update group completed successfully. Jul 03 23:56:41 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4f8013aa-549c-4a8f-842c-bc4ff7c4eb33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3" returned: 0 in 1.044s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4f8013aa-549c-4a8f-842c-bc4ff7c4eb33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:41 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1 1G Jul 03 23:56:41 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:42 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4f8013aa-549c-4a8f-842c-bc4ff7c4eb33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1 1G" returned: 0 in 1.145s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4f8013aa-549c-4a8f-842c-bc4ff7c4eb33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:42 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1 Jul 03 23:56:42 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-cf88078e-181a-4137-aff1-2cfabec9a9c1 tempest-GroupsTest-746959068 None] Update group completed successfully. Jul 03 23:56:43 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4f8013aa-549c-4a8f-842c-bc4ff7c4eb33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1" returned: 0 in 0.866s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:43 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-4f8013aa-549c-4a8f-842c-bc4ff7c4eb33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1 is being set with open permissions: ugo+rw Jul 03 23:56:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4f8013aa-549c-4a8f-842c-bc4ff7c4eb33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:43 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1 Jul 03 23:56:43 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:44 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4f8013aa-549c-4a8f-842c-bc4ff7c4eb33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1" returned: 0 in 0.698s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4f8013aa-549c-4a8f-842c-bc4ff7c4eb33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:44 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.info Jul 03 23:56:44 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Acquiring lock "cinder-quobyte-a7594b2c-7a03-421f-b70f-a6a192c06e96" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:56:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Lock "cinder-quobyte-a7594b2c-7a03-421f-b70f-a6a192c06e96" acquired by "delete_volume" :: waited 0.045s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:56:44 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19cbc51-2755-4edc-ae05-4afae0939427]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:56:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a7594b2c-7a03-421f-b70f-a6a192c06e96 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:45 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a7594b2c-7a03-421f-b70f-a6a192c06e96 Jul 03 23:56:45 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:45 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4f8013aa-549c-4a8f-842c-bc4ff7c4eb33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.info" returned: 0 in 0.933s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:45 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-4f8013aa-549c-4a8f-842c-bc4ff7c4eb33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.info is being set with open permissions: ugo+rw Jul 03 23:56:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4f8013aa-549c-4a8f-842c-bc4ff7c4eb33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:45 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.info Jul 03 23:56:45 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:46 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a7594b2c-7a03-421f-b70f-a6a192c06e96" returned: 0 in 1.046s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a7594b2c-7a03-421f-b70f-a6a192c06e96 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:46 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a7594b2c-7a03-421f-b70f-a6a192c06e96 Jul 03 23:56:46 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:46 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4f8013aa-549c-4a8f-842c-bc4ff7c4eb33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.info" returned: 0 in 0.879s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4f8013aa-549c-4a8f-842c-bc4ff7c4eb33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.701s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:46 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4f8013aa-549c-4a8f-842c-bc4ff7c4eb33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Create snapshot completed successfully Jul 03 23:56:46 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a7594b2c-7a03-421f-b70f-a6a192c06e96" returned: 0 in 0.905s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Lock "cinder-quobyte-a7594b2c-7a03-421f-b70f-a6a192c06e96" released by "delete_volume" :: held 2.026s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:56:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Acquiring lock "cinder-quobyte-f15cf8af-579e-4780-aee0-e5b706e13c3e" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:56:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Lock "cinder-quobyte-f15cf8af-579e-4780-aee0-e5b706e13c3e" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:56:47 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c571c3-03ef-44af-9656-f3b895083fc7]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:56:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f15cf8af-579e-4780-aee0-e5b706e13c3e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:47 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f15cf8af-579e-4780-aee0-e5b706e13c3e Jul 03 23:56:47 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:48 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f15cf8af-579e-4780-aee0-e5b706e13c3e" returned: 0 in 1.024s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f15cf8af-579e-4780-aee0-e5b706e13c3e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:48 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f15cf8af-579e-4780-aee0-e5b706e13c3e Jul 03 23:56:48 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Acquiring lock "cinder-7de0b390-9581-4148-9006-fabf43338bd1-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:56:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Lock "cinder-7de0b390-9581-4148-9006-fabf43338bd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:56:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Acquiring lock "cinder-quobyte-da60f8c0-b02a-423e-8ffb-2d4ac51014f3" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:56:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Lock "cinder-quobyte-da60f8c0-b02a-423e-8ffb-2d4ac51014f3" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:56:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Acquiring lock "cinder-quobyte-7de0b390-9581-4148-9006-fabf43338bd1" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:56:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Lock "cinder-quobyte-7de0b390-9581-4148-9006-fabf43338bd1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:56:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Deleting offline snapshot 7de0b390-9581-4148-9006-fabf43338bd1 of volume da60f8c0-b02a-423e-8ffb-2d4ac51014f3 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 23:56:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] snapshot_file for this snap is: volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 23:56:48 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba944a5c-0b10-463f-af82-50a456550d68]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:56:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:48 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1 Jul 03 23:56:48 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:48 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f15cf8af-579e-4780-aee0-e5b706e13c3e" returned: 0 in 0.741s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Lock "cinder-quobyte-f15cf8af-579e-4780-aee0-e5b706e13c3e" released by "delete_volume" :: held 1.852s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:56:48 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Created reservations ['db089867-b749-489b-8bad-02d1b07d2fbe'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:56:49 devstack cinder-volume[86676]: WARNING cinder.quota [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1835681157 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1835681157, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:56:49 devstack cinder-volume[86676]: WARNING cinder.quota [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1835681157 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1835681157, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:56:49 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Created reservations ['716cce68-d45a-4536-9e3a-8adc601b98a9', 'a4089a09-0505-4409-8a3f-5f66d8851c4e', '23d4c09e-bab7-425c-9ccb-8f1799fe9300', '824b32bb-58ee-4194-8cf1-ac689f60c2f0'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:56:49 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Created reservations ['61446262-090a-4975-9f8c-820a2e7f6db4', 'a98c3dcc-a614-4224-86c9-e6964a25fdc1', '4318d226-fc2b-4617-9ede-66d93996f5c9', '54997da5-b0a4-4aa9-a582-6d9338f8b487'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:56:49 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1" returned: 0 in 1.109s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:56:49 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7fc359-ffb2-4db3-b4b0-d563ea1b4197]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:56:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:56:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:56:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:49 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:56:49 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:49 devstack sudo[95191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3 Jul 03 23:56:49 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:50 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.913s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:50 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:56:50 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5e30a7a7-9b34-4280-96c0-5ca613372043 tempest-GroupsTest-746959068 None] Delete group completed successfully. Jul 03 23:56:50 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3" returned: 0 in 1.238s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:50 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1 Jul 03 23:56:50 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:51 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1" returned: 0 in 1.207s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:51 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1 Jul 03 23:56:51 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:52 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3.7de0b390-9581-4148-9006-fabf43338bd1" returned: 0 in 1.053s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Lock "cinder-quobyte-7de0b390-9581-4148-9006-fabf43338bd1" released by "_delete_snapshot" :: held 4.749s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:56:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Lock "cinder-quobyte-da60f8c0-b02a-423e-8ffb-2d4ac51014f3" released by "delete_snapshot" :: held 4.778s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:56:53 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Created reservations ['16ae8334-c824-4fdb-8e67-818c0cf2acff', '83d291e4-9943-45a2-a963-a7429d74032d', '526a7583-26c5-4980-8c12-e99ec175ae6e', 'b8daa4ac-fc9d-43b7-81e7-ba5c239058d5'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:56:53 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Delete snapshot completed successfully. Jul 03 23:56:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eb58d00f-fe55-437f-8c81-b1427b0a04d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Lock "cinder-7de0b390-9581-4148-9006-fabf43338bd1-delete_snapshot" released by "delete_snapshot" :: held 4.962s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:56:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Acquiring lock "cinder-da60f8c0-b02a-423e-8ffb-2d4ac51014f3-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:56:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Lock "cinder-da60f8c0-b02a-423e-8ffb-2d4ac51014f3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:56:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Acquiring lock "cinder-quobyte-da60f8c0-b02a-423e-8ffb-2d4ac51014f3" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:56:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Lock "cinder-quobyte-da60f8c0-b02a-423e-8ffb-2d4ac51014f3" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:56:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b9584b-ebf2-4d01-991c-b4742f4050b6]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:56:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:53 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3 Jul 03 23:56:53 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:54 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3" returned: 0 in 1.062s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:54 devstack sudo[95218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3 Jul 03 23:56:54 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:55 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da60f8c0-b02a-423e-8ffb-2d4ac51014f3" returned: 0 in 0.893s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Lock "cinder-quobyte-da60f8c0-b02a-423e-8ffb-2d4ac51014f3" released by "delete_volume" :: held 2.058s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:56:55 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=112,cinder:INSERT=34,cinder:UPDATE=138,cinder:DELETE=6 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:56:55 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:INSERT=26,cinder:UPDATE=129,cinder:SELECT=124,cinder:DELETE=7 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:56:55 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Created reservations ['7975aa4f-1f99-449a-91da-97f9e3397790', '842d16a6-8e78-4764-bb5b-f6be55a05a79', '57a73803-c30d-48f3-91d3-50bd13d1c3d7', '0342cd72-d794-458b-919a-e9fd35da7459'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:56:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:56:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:56:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:56:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:56:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:56:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:56:56 devstack sudo[95221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:56:56 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:56:56 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root Jul 03 23:56:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.862s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:56:56 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:56:56 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Deleted volume successfully. Jul 03 23:56:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-749dac94-d172-4310-9314-a4b36c6ccd45 tempest-VolumeSnapshotQuotasNegativeTestJSON-1233699484 None] Lock "cinder-da60f8c0-b02a-423e-8ffb-2d4ac51014f3-delete_volume" released by "delete_volume" :: held 3.272s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Flow 'volume_create_manager' (4c46df0e-e3e1-4a30-9cce-08fddc842a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d29ae2-e45c-4800-bf02-e76cc845ce7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d29ae2-e45c-4800-bf02-e76cc845ce7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-664960522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6276e00-46ee-4fe5-9483-7d1510813254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='114f1de054374a8098567240bedcd347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:00Z,use_quota=True,user_id='8db2b07e76f649f29bffdf08f8e90ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8841efbe-4eb1-4aea-afb3-dbd985ba774e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8841efbe-4eb1-4aea-afb3-dbd985ba774e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0305a8f1-2356-432b-ae9f-79efb9a63c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0305a8f1-2356-432b-ae9f-79efb9a63c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6276e00-46ee-4fe5-9483-7d1510813254', 'volume_name': 'volume-b6276e00-46ee-4fe5-9483-7d1510813254', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1036f2-ebc8-4f6a-87fd-091a266ab88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1036f2-ebc8-4f6a-87fd-091a266ab88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8dd379-6676-4e55-b5bc-8929c8c40f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:00 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Volume b6276e00-46ee-4fe5-9483-7d1510813254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6276e00-46ee-4fe5-9483-7d1510813254', 'volume_size': 1} Jul 03 23:57:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-664960522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6276e00-46ee-4fe5-9483-7d1510813254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='114f1de054374a8098567240bedcd347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:00Z,use_quota=True,user_id='8db2b07e76f649f29bffdf08f8e90ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:57:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Creating volume b6276e00-46ee-4fe5-9483-7d1510813254 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:57:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:57:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:57:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:57:00 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:57:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:00 devstack sudo[95225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 1073741824 Jul 03 23:57:00 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:01 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 1073741824" returned: 0 in 1.159s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:01 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 Jul 03 23:57:01 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:02 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254" returned: 0 in 0.847s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] <== create_volume: return (2105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.107s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8dd379-6676-4e55-b5bc-8929c8c40f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6276e00-46ee-4fe5-9483-7d1510813254', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f1d2f1-f49b-4c73-bd2d-2cd588ab8654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:02 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Volume volume-b6276e00-46ee-4fe5-9483-7d1510813254 (b6276e00-46ee-4fe5-9483-7d1510813254): created successfully Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f1d2f1-f49b-4c73-bd2d-2cd588ab8654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Flow 'volume_create_manager' (4c46df0e-e3e1-4a30-9cce-08fddc842a43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:57:02 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7befdfa0-64d9-46b3-9c01-666e7a7a3c5f tempest-VolumesActionsTest-1510068861 None] Created volume successfully. Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Flow 'volume_create_manager' (fd4156ef-77cd-4e20-a425-649eb3f4e524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8d99ef-fa0a-4f92-97c0-f7ac110e055b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8d99ef-fa0a-4f92-97c0-f7ac110e055b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2052450377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1cd22e7-cb18-473c-9159-69e25b81de83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09bc952ef46145ce80bc6cf6001b46d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:03Z,use_quota=True,user_id='7f880da537b34715a95a9bf878c252ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bfabd27-419e-49de-9bc8-7cae4a555b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bfabd27-419e-49de-9bc8-7cae4a555b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba5f1dd-d529-4560-93f9-30927c1ef942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba5f1dd-d529-4560-93f9-30927c1ef942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1cd22e7-cb18-473c-9159-69e25b81de83', 'volume_name': 'volume-a1cd22e7-cb18-473c-9159-69e25b81de83', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363a4135-da6d-4dc4-a174-66675d0972d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363a4135-da6d-4dc4-a174-66675d0972d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd6d56f-3d12-490a-b3dd-7c1625119664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:02 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Volume a1cd22e7-cb18-473c-9159-69e25b81de83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1cd22e7-cb18-473c-9159-69e25b81de83', 'volume_size': 1} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2052450377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1cd22e7-cb18-473c-9159-69e25b81de83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09bc952ef46145ce80bc6cf6001b46d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:03Z,use_quota=True,user_id='7f880da537b34715a95a9bf878c252ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Creating volume a1cd22e7-cb18-473c-9159-69e25b81de83 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:57:02 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:57:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:02 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83 1073741824 Jul 03 23:57:02 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:04 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83 1073741824" returned: 0 in 1.412s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:04 devstack sudo[95241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83 Jul 03 23:57:04 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:04 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:57:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Flow 'volume_create_manager' (ac7939c8-da70-4e22-8e35-c0e34cc322d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:57:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b541eff5-af59-421a-b13f-06aa4c89d525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b541eff5-af59-421a-b13f-06aa4c89d525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-641718490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017b2dad-283f-4c64-a585-8d5108cb2398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7268e439d23642e294f5d2422699990b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:05Z,use_quota=True,user_id='c6f13df38d9c485783ad68ecf13a9f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98abc6a8-eefb-4304-a9c4-f6130b570572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98abc6a8-eefb-4304-a9c4-f6130b570572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c02e33-ea17-4dcc-bcb4-bc06931e73e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c02e33-ea17-4dcc-bcb4-bc06931e73e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '017b2dad-283f-4c64-a585-8d5108cb2398', 'volume_name': 'volume-017b2dad-283f-4c64-a585-8d5108cb2398', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9bc046-8651-427b-99cc-52df1b5b7537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9bc046-8651-427b-99cc-52df1b5b7537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1929380d-d95c-41c7-a120-75dc16743a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:04 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Volume 017b2dad-283f-4c64-a585-8d5108cb2398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-017b2dad-283f-4c64-a585-8d5108cb2398', 'volume_size': 1} Jul 03 23:57:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:05 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83" returned: 0 in 0.993s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] <== create_volume: return (2484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.487s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.489s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-641718490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017b2dad-283f-4c64-a585-8d5108cb2398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7268e439d23642e294f5d2422699990b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:05Z,use_quota=True,user_id='c6f13df38d9c485783ad68ecf13a9f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Creating volume 017b2dad-283f-4c64-a585-8d5108cb2398 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:57:05 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-017b2dad-283f-4c64-a585-8d5108cb2398 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd6d56f-3d12-490a-b3dd-7c1625119664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1cd22e7-cb18-473c-9159-69e25b81de83', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74be868f-1bf1-4808-b386-950f6482f3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:05 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-017b2dad-283f-4c64-a585-8d5108cb2398 1073741824 Jul 03 23:57:05 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:05 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Volume volume-a1cd22e7-cb18-473c-9159-69e25b81de83 (a1cd22e7-cb18-473c-9159-69e25b81de83): created successfully Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74be868f-1bf1-4808-b386-950f6482f3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Flow 'volume_create_manager' (fd4156ef-77cd-4e20-a425-649eb3f4e524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:57:05 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-98991893-8bb1-4a3e-a025-a1ca1f67e3a2 tempest-SnapshotsActionsTest-1807069848 None] Created volume successfully. Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Flow 'volume_create_manager' (f36d5e69-c7ca-4bda-b354-8cfbd44e42bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1ad1af-ba68-459b-a3af-8bd6b7467887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1ad1af-ba68-459b-a3af-8bd6b7467887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-107882186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3920fe4a-125c-42c3-b606-a82f845281df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbdc441a7023454fa9405c5c5be3afca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:06Z,use_quota=True,user_id='0cacaa8a7b1e4bb0ad37ecaa35ae900d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50b8e34-127e-4a7a-9277-5ff029c3b18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50b8e34-127e-4a7a-9277-5ff029c3b18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759bc834-802d-4629-ac44-3d9619f37e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759bc834-802d-4629-ac44-3d9619f37e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3920fe4a-125c-42c3-b606-a82f845281df', 'volume_name': 'volume-3920fe4a-125c-42c3-b606-a82f845281df', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e864142d-4cb3-451b-94ea-0ae5a3ef98b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e864142d-4cb3-451b-94ea-0ae5a3ef98b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e40aa2-a522-4f5c-b707-582963c31f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:05 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Volume 3920fe4a-125c-42c3-b606-a82f845281df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3920fe4a-125c-42c3-b606-a82f845281df', 'volume_size': 1} Jul 03 23:57:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9fc48a36-865f-49a7-8741-cd0c078f2ffe tempest-SnapshotsActionsTest-1807069848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:06 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-017b2dad-283f-4c64-a585-8d5108cb2398 1073741824" returned: 0 in 1.155s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-017b2dad-283f-4c64-a585-8d5108cb2398 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:06 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-017b2dad-283f-4c64-a585-8d5108cb2398 Jul 03 23:57:06 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:07 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-017b2dad-283f-4c64-a585-8d5108cb2398" returned: 0 in 0.720s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.436s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-107882186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3920fe4a-125c-42c3-b606-a82f845281df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbdc441a7023454fa9405c5c5be3afca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:06Z,use_quota=True,user_id='0cacaa8a7b1e4bb0ad37ecaa35ae900d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Creating volume 3920fe4a-125c-42c3-b606-a82f845281df {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:57:07 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3920fe4a-125c-42c3-b606-a82f845281df 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1929380d-d95c-41c7-a120-75dc16743a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-017b2dad-283f-4c64-a585-8d5108cb2398', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b9428c-9760-4655-aaaa-4746bf5f00dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:07 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3920fe4a-125c-42c3-b606-a82f845281df 1073741824 Jul 03 23:57:07 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:07 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Volume volume-017b2dad-283f-4c64-a585-8d5108cb2398 (017b2dad-283f-4c64-a585-8d5108cb2398): created successfully Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b9428c-9760-4655-aaaa-4746bf5f00dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Flow 'volume_create_manager' (ac7939c8-da70-4e22-8e35-c0e34cc322d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:57:07 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-90a7a725-4f59-4020-bd20-a7cce8e9b439 tempest-VolumeQuotasAdminTestJSON-776800310 None] Created volume successfully. Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] Acquiring lock "cinder-017b2dad-283f-4c64-a585-8d5108cb2398-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] Lock "cinder-017b2dad-283f-4c64-a585-8d5108cb2398-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] Acquiring lock "cinder-quobyte-017b2dad-283f-4c64-a585-8d5108cb2398" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] Lock "cinder-quobyte-017b2dad-283f-4c64-a585-8d5108cb2398" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afdbb7b-6aca-41e0-ba9c-e3fb1a0331da]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-017b2dad-283f-4c64-a585-8d5108cb2398 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:08 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-017b2dad-283f-4c64-a585-8d5108cb2398 Jul 03 23:57:08 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:08 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3920fe4a-125c-42c3-b606-a82f845281df 1073741824" returned: 0 in 0.931s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3920fe4a-125c-42c3-b606-a82f845281df {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:08 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3920fe4a-125c-42c3-b606-a82f845281df Jul 03 23:57:08 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:08 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-017b2dad-283f-4c64-a585-8d5108cb2398" returned: 0 in 0.865s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-017b2dad-283f-4c64-a585-8d5108cb2398 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:08 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-017b2dad-283f-4c64-a585-8d5108cb2398 Jul 03 23:57:08 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:08 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3920fe4a-125c-42c3-b606-a82f845281df" returned: 0 in 0.681s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:57:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9fc48a36-865f-49a7-8741-cd0c078f2ffe tempest-SnapshotsActionsTest-1807069848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.785s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9fc48a36-865f-49a7-8741-cd0c078f2ffe tempest-SnapshotsActionsTest-1807069848 None] Creating offline snapshot 5c2a1585-a1c1-4441-acf4-2ed9e3696984 of volume a1cd22e7-cb18-473c-9159-69e25b81de83 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 23:57:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e40aa2-a522-4f5c-b707-582963c31f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3920fe4a-125c-42c3-b606-a82f845281df', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b5931d-ff36-4d75-afe1-b0df236bc3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:09 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8dc545-a28a-4999-858c-3487e90ae0d1]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fc48a36-865f-49a7-8741-cd0c078f2ffe tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:09 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Volume volume-3920fe4a-125c-42c3-b606-a82f845281df (3920fe4a-125c-42c3-b606-a82f845281df): created successfully Jul 03 23:57:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b5931d-ff36-4d75-afe1-b0df236bc3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Flow 'volume_create_manager' (f36d5e69-c7ca-4bda-b354-8cfbd44e42bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:57:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-aa249f32-7b57-474a-8411-27b52acd9012 tempest-VolumesMetadataTest-1782101366 None] Created volume successfully. Jul 03 23:57:09 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83 Jul 03 23:57:09 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:09 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-017b2dad-283f-4c64-a585-8d5108cb2398" returned: 0 in 0.706s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] Lock "cinder-quobyte-017b2dad-283f-4c64-a585-8d5108cb2398" released by "delete_volume" :: held 1.610s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:09 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] Created reservations ['0d0685f3-2901-4deb-9b2d-4e73a6786ee3', 'b6484e6a-abdb-4428-8005-a1771b3bbfaf', 'b69656df-b41d-49ea-80d6-67e4c6979c82', '0d7105ce-340d-418d-9fd3-31245300609d'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:57:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:57:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:57:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:09 devstack sudo[95277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:57:09 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:09 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fc48a36-865f-49a7-8741-cd0c078f2ffe tempest-SnapshotsActionsTest-1807069848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83" returned: 0 in 0.891s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fc48a36-865f-49a7-8741-cd0c078f2ffe tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:09 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 1G Jul 03 23:57:09 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:10 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.141s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:10 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:57:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] Deleted volume successfully. Jul 03 23:57:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7f605e28-4992-4201-bf1e-f5a04b195c60 tempest-VolumeQuotasAdminTestJSON-776800310 None] Lock "cinder-017b2dad-283f-4c64-a585-8d5108cb2398-delete_volume" released by "delete_volume" :: held 3.030s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] Acquiring lock "cinder-3920fe4a-125c-42c3-b606-a82f845281df-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] Lock "cinder-3920fe4a-125c-42c3-b606-a82f845281df-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Flow 'volume_create_manager' (e66095fe-3220-449c-a7c7-ea57f14ee965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791d64fd-4609-4fff-80ac-e35e8088d05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] Acquiring lock "cinder-quobyte-3920fe4a-125c-42c3-b606-a82f845281df" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:11 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791d64fd-4609-4fff-80ac-e35e8088d05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1849249512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f352673f-2c63-49a3-9d8a-ed43cd53a6f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7268e439d23642e294f5d2422699990b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:11Z,use_quota=True,user_id='c6f13df38d9c485783ad68ecf13a9f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855fa56b-04a2-4e41-a6df-794cad90745f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855fa56b-04a2-4e41-a6df-794cad90745f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e048772b-c968-4c14-8a72-85247fe49ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e048772b-c968-4c14-8a72-85247fe49ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f352673f-2c63-49a3-9d8a-ed43cd53a6f0', 'volume_name': 'volume-f352673f-2c63-49a3-9d8a-ed43cd53a6f0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f605bb-c1ae-4e6d-8ba0-936cea909637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f605bb-c1ae-4e6d-8ba0-936cea909637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730136f1-8435-4273-a6ef-d73e4ee52802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:11 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Volume f352673f-2c63-49a3-9d8a-ed43cd53a6f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f352673f-2c63-49a3-9d8a-ed43cd53a6f0', 'volume_size': 1} Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fc48a36-865f-49a7-8741-cd0c078f2ffe tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 1G" returned: 0 in 1.486s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fc48a36-865f-49a7-8741-cd0c078f2ffe tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1cd22e7-cb18-473c-9159-69e25b81de83 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] Lock "cinder-quobyte-3920fe4a-125c-42c3-b606-a82f845281df" acquired by "delete_volume" :: waited 0.100s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:11 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1cd22e7-cb18-473c-9159-69e25b81de83 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 Jul 03 23:57:11 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[986fd20a-c6df-489f-8b12-33a6cc4f8f47]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3920fe4a-125c-42c3-b606-a82f845281df {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:11 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3920fe4a-125c-42c3-b606-a82f845281df Jul 03 23:57:11 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:12 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fc48a36-865f-49a7-8741-cd0c078f2ffe tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1cd22e7-cb18-473c-9159-69e25b81de83 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984" returned: 0 in 0.997s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:12 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-9fc48a36-865f-49a7-8741-cd0c078f2ffe tempest-SnapshotsActionsTest-1807069848 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 is being set with open permissions: ugo+rw Jul 03 23:57:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fc48a36-865f-49a7-8741-cd0c078f2ffe tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:12 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 Jul 03 23:57:12 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:12 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3920fe4a-125c-42c3-b606-a82f845281df" returned: 0 in 0.995s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3920fe4a-125c-42c3-b606-a82f845281df {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:12 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3920fe4a-125c-42c3-b606-a82f845281df Jul 03 23:57:12 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:13 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fc48a36-865f-49a7-8741-cd0c078f2ffe tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984" returned: 0 in 0.767s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fc48a36-865f-49a7-8741-cd0c078f2ffe tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:13 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.info Jul 03 23:57:13 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:13 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3920fe4a-125c-42c3-b606-a82f845281df" returned: 0 in 0.795s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] Lock "cinder-quobyte-3920fe4a-125c-42c3-b606-a82f845281df" released by "delete_volume" :: held 1.834s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:13 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] Created reservations ['18bd52b9-ddea-438c-93b6-27124c9e76c2', '293d0336-f201-4666-a523-7d74b47dfed5', '3347d159-568e-475f-8244-d4ed8fb61a79', 'acd03743-d8fa-4822-aaab-f5fcd2b3d978'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:57:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:57:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:57:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:13 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:57:13 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:13 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fc48a36-865f-49a7-8741-cd0c078f2ffe tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.info" returned: 0 in 0.706s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:13 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-9fc48a36-865f-49a7-8741-cd0c078f2ffe tempest-SnapshotsActionsTest-1807069848 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.info is being set with open permissions: ugo+rw Jul 03 23:57:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fc48a36-865f-49a7-8741-cd0c078f2ffe tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:13 devstack sudo[95325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.info Jul 03 23:57:13 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:14 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.713s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:14 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:57:14 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] Deleted volume successfully. Jul 03 23:57:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-be790fda-9295-4889-ab10-8d501b449924 tempest-VolumesMetadataTest-1782101366 None] Lock "cinder-3920fe4a-125c-42c3-b606-a82f845281df-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:14 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fc48a36-865f-49a7-8741-cd0c078f2ffe tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.info" returned: 0 in 0.704s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9fc48a36-865f-49a7-8741-cd0c078f2ffe tempest-SnapshotsActionsTest-1807069848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.688s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.246s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1849249512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f352673f-2c63-49a3-9d8a-ed43cd53a6f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7268e439d23642e294f5d2422699990b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:11Z,use_quota=True,user_id='c6f13df38d9c485783ad68ecf13a9f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:57:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Creating volume f352673f-2c63-49a3-9d8a-ed43cd53a6f0 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:57:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:57:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:57:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:57:14 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:57:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f352673f-2c63-49a3-9d8a-ed43cd53a6f0 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:14 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f352673f-2c63-49a3-9d8a-ed43cd53a6f0 1073741824 Jul 03 23:57:14 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:14 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9fc48a36-865f-49a7-8741-cd0c078f2ffe tempest-SnapshotsActionsTest-1807069848 None] Create snapshot completed successfully Jul 03 23:57:15 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f352673f-2c63-49a3-9d8a-ed43cd53a6f0 1073741824" returned: 0 in 1.014s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f352673f-2c63-49a3-9d8a-ed43cd53a6f0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:15 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f352673f-2c63-49a3-9d8a-ed43cd53a6f0 Jul 03 23:57:15 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f3e87798-8e7f-48ec-af92-2fff79abcff4 tempest-SnapshotsActionsTest-1807069848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:16 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f352673f-2c63-49a3-9d8a-ed43cd53a6f0" returned: 0 in 1.144s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f3e87798-8e7f-48ec-af92-2fff79abcff4 tempest-SnapshotsActionsTest-1807069848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.191s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-f3e87798-8e7f-48ec-af92-2fff79abcff4 tempest-SnapshotsActionsTest-1807069848 None] Creating offline snapshot 3057f693-d710-4df9-8927-ca7c5e8047d3 of volume a1cd22e7-cb18-473c-9159-69e25b81de83 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 23:57:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730136f1-8435-4273-a6ef-d73e4ee52802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f352673f-2c63-49a3-9d8a-ed43cd53a6f0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (932705f6-353c-4e7f-aa1b-29489f7d3082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:16 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc83d18-63c2-40a3-92b6-66711abf325e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f3e87798-8e7f-48ec-af92-2fff79abcff4 tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:17 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Volume volume-f352673f-2c63-49a3-9d8a-ed43cd53a6f0 (f352673f-2c63-49a3-9d8a-ed43cd53a6f0): created successfully Jul 03 23:57:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (932705f6-353c-4e7f-aa1b-29489f7d3082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Flow 'volume_create_manager' (e66095fe-3220-449c-a7c7-ea57f14ee965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:57:17 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7ad95688-e466-4c25-abac-2649f11329c9 tempest-VolumeQuotasAdminTestJSON-776800310 None] Created volume successfully. Jul 03 23:57:17 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 Jul 03 23:57:17 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:18 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f3e87798-8e7f-48ec-af92-2fff79abcff4 tempest-SnapshotsActionsTest-1807069848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984" returned: 0 in 1.100s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-f3e87798-8e7f-48ec-af92-2fff79abcff4 tempest-SnapshotsActionsTest-1807069848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1cd22e7-cb18-473c-9159-69e25b81de83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:57:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f3e87798-8e7f-48ec-af92-2fff79abcff4 tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:18 devstack sudo[95409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3 1G Jul 03 23:57:18 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-63331d80-135e-45b4-a5bc-9e51334c378d tempest-VolumeQuotasAdminTestJSON-1307042682 None] Transfer volume completed successfully. Jul 03 23:57:19 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f3e87798-8e7f-48ec-af92-2fff79abcff4 tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3 1G" returned: 0 in 1.257s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f3e87798-8e7f-48ec-af92-2fff79abcff4 tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:19 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3 Jul 03 23:57:19 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:19 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:57:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Flow 'volume_create_manager' (2100da11-f915-4504-82cf-019e520b4ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:57:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aadebd2-48a6-48a1-a68c-e0bd45d3a562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aadebd2-48a6-48a1-a68c-e0bd45d3a562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1511712214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3608be1-9819-4597-af33-392bf9ab6cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31671a164582493089d47ca17878b558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:19Z,use_quota=True,user_id='4f5c20e06ff749a0aa5706c46c658983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5a76d5-55fb-4957-8b1b-b1395dd0a972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5a76d5-55fb-4957-8b1b-b1395dd0a972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d9c6ca-929e-4685-9a1c-e0723af81295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:19 devstack cinder-volume[86676]: DEBUG cinder.image.glance [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Creating Keystone auth plugin from conf {{(pid=86676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 23:57:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] Acquiring lock "cinder-f352673f-2c63-49a3-9d8a-ed43cd53a6f0-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] Lock "cinder-f352673f-2c63-49a3-9d8a-ed43cd53a6f0-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] Acquiring lock "cinder-quobyte-f352673f-2c63-49a3-9d8a-ed43cd53a6f0" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] Lock "cinder-quobyte-f352673f-2c63-49a3-9d8a-ed43cd53a6f0" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:20 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74c8509-e2f5-419d-b718-0c36db501219]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f352673f-2c63-49a3-9d8a-ed43cd53a6f0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:20 devstack sudo[95419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f352673f-2c63-49a3-9d8a-ed43cd53a6f0 Jul 03 23:57:20 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d9c6ca-929e-4685-9a1c-e0723af81295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a3608be1-9819-4597-af33-392bf9ab6cbe', 'volume_name': 'volume-a3608be1-9819-4597-af33-392bf9ab6cbe', 'volume_size': 1, 'image_id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47a94a0f3bea4708b842e25ca5b22b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8f7bb2-fd8b-4905-901f-fb69a988de19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8f7bb2-fd8b-4905-901f-fb69a988de19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3963d7a-1959-49eb-af4c-31d966951c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:20 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Volume a3608be1-9819-4597-af33-392bf9ab6cbe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a3608be1-9819-4597-af33-392bf9ab6cbe', 'volume_size': 1, 'image_id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47a94a0f3bea4708b842e25ca5b22b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 23:57:20 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Trying to clone a3608be1-9819-4597-af33-392bf9ab6cbe from image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}]). {{(pid=86676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 23:57:20 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f3e87798-8e7f-48ec-af92-2fff79abcff4 tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3" returned: 0 in 1.152s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:20 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-f3e87798-8e7f-48ec-af92-2fff79abcff4 tempest-SnapshotsActionsTest-1807069848 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3 is being set with open permissions: ugo+rw Jul 03 23:57:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f3e87798-8e7f-48ec-af92-2fff79abcff4 tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:20 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3 Jul 03 23:57:20 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:21 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9yopxo2ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 23:57:21 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Image download 20.69 MB at 20.69 MB/s Jul 03 23:57:21 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb1f894-2341-4142-9396-d1419d15b846]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9yopxo2ndevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:21 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f352673f-2c63-49a3-9d8a-ed43cd53a6f0" returned: 0 in 1.249s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f352673f-2c63-49a3-9d8a-ed43cd53a6f0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:21 devstack sudo[95451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f352673f-2c63-49a3-9d8a-ed43cd53a6f0 Jul 03 23:57:21 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:21 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9yopxo2ndevstack@QuobyteHD Jul 03 23:57:21 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:21 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f3e87798-8e7f-48ec-af92-2fff79abcff4 tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3" returned: 0 in 1.194s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f3e87798-8e7f-48ec-af92-2fff79abcff4 tempest-SnapshotsActionsTest-1807069848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.871s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ab90f6c3-34b3-4fc0-8083-95e31721d356 tempest-VolumesActionsTest-1510068861 None] Acquiring lock "cinder-b6276e00-46ee-4fe5-9483-7d1510813254" by "attach_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ab90f6c3-34b3-4fc0-8083-95e31721d356 tempest-VolumesActionsTest-1510068861 None] Lock "cinder-b6276e00-46ee-4fe5-9483-7d1510813254" acquired by "attach_volume" :: waited 0.043s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:21 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f3e87798-8e7f-48ec-af92-2fff79abcff4 tempest-SnapshotsActionsTest-1807069848 None] Create snapshot completed successfully Jul 03 23:57:21 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ab90f6c3-34b3-4fc0-8083-95e31721d356 tempest-VolumesActionsTest-1510068861 None] Attaching volume b6276e00-46ee-4fe5-9483-7d1510813254 to instance e2ab483d-aeb3-43e3-bf09-120c88278b09 at mountpoint /dev/vdb on host None. Jul 03 23:57:21 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ab90f6c3-34b3-4fc0-8083-95e31721d356 tempest-VolumesActionsTest-1510068861 None] Attach volume completed successfully. Jul 03 23:57:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ab90f6c3-34b3-4fc0-8083-95e31721d356 tempest-VolumesActionsTest-1510068861 None] Lock "cinder-b6276e00-46ee-4fe5-9483-7d1510813254" released by "attach_volume" :: held 0.159s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:22 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f352673f-2c63-49a3-9d8a-ed43cd53a6f0" returned: 0 in 0.957s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] Lock "cinder-quobyte-f352673f-2c63-49a3-9d8a-ed43cd53a6f0" released by "delete_volume" :: held 2.274s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] Created reservations ['877e9cf1-5d45-4a4a-b0ec-453bec21dde0', '94ce0d4b-8e9b-49a3-af22-9dc7d9aeebd3', '083ff960-c029-4379-803f-fe3854179ad2', '01f59e9a-42b0-4ad8-8d6a-614bf38227eb'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:57:22 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9yopxo2ndevstack@QuobyteHD" returned: 0 in 1.132s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Temporary image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 is fetched for user 4f5c20e06ff749a0aa5706c46c658983. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6a6683a1-4ba1-4be0-8ad0-7f0dccecc3bf tempest-VolumesActionsTest-1510068861 None] Acquiring lock "cinder-b6276e00-46ee-4fe5-9483-7d1510813254-detach_volume" by "detach_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6a6683a1-4ba1-4be0-8ad0-7f0dccecc3bf tempest-VolumesActionsTest-1510068861 None] Lock "cinder-b6276e00-46ee-4fe5-9483-7d1510813254-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6a6683a1-4ba1-4be0-8ad0-7f0dccecc3bf tempest-VolumesActionsTest-1510068861 None] Detaching volume b6276e00-46ee-4fe5-9483-7d1510813254 from instance e2ab483d-aeb3-43e3-bf09-120c88278b09. Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:22 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:57:22 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dcfd7f-2a2a-46ab-9d5c-f0d7b6276e0f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9yopxo2ndevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] Acquiring lock "cinder-3057f693-d710-4df9-8927-ca7c5e8047d3-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6a6683a1-4ba1-4be0-8ad0-7f0dccecc3bf tempest-VolumesActionsTest-1510068861 None] Detach volume completed successfully. Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6a6683a1-4ba1-4be0-8ad0-7f0dccecc3bf tempest-VolumesActionsTest-1510068861 None] Lock "cinder-b6276e00-46ee-4fe5-9483-7d1510813254-detach_volume" released by "detach_volume" :: held 0.168s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-3057f693-d710-4df9-8927-ca7c5e8047d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] Acquiring lock "cinder-quobyte-a1cd22e7-cb18-473c-9159-69e25b81de83" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-quobyte-a1cd22e7-cb18-473c-9159-69e25b81de83" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] Acquiring lock "cinder-quobyte-3057f693-d710-4df9-8927-ca7c5e8047d3" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-quobyte-3057f693-d710-4df9-8927-ca7c5e8047d3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] Deleting offline snapshot 3057f693-d710-4df9-8927-ca7c5e8047d3 of volume a1cd22e7-cb18-473c-9159-69e25b81de83 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 23:57:22 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9yopxo2ndevstack@QuobyteHD Jul 03 23:57:22 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] snapshot_file for this snap is: volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5843e3f2-d8ad-48ca-a21e-f0851122da67]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:22 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3 Jul 03 23:57:22 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:23 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9yopxo2ndevstack@QuobyteHD" returned: 0 in 0.895s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1511712214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3608be1-9819-4597-af33-392bf9ab6cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31671a164582493089d47ca17878b558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:19Z,use_quota=True,user_id='4f5c20e06ff749a0aa5706c46c658983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:57:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Creating volume a3608be1-9819-4597-af33-392bf9ab6cbe {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:57:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:57:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:57:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:57:23 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:57:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:23 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe 1073741824 Jul 03 23:57:23 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.113s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:23 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:23 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:57:23 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] Deleted volume successfully. Jul 03 23:57:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7b065340-ac2b-4033-bf99-dff69a748c26 tempest-VolumeQuotasAdminTestJSON-1758233238 None] Lock "cinder-f352673f-2c63-49a3-9d8a-ed43cd53a6f0-delete_volume" released by "delete_volume" :: held 3.809s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:24 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3" returned: 0 in 1.350s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1cd22e7-cb18-473c-9159-69e25b81de83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:57:24 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0b1948-b301-4429-97e2-98126d9800bb]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:24 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 Jul 03 23:57:24 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:24 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe 1073741824" returned: 0 in 1.272s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:24 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe Jul 03 23:57:24 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:25 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984" returned: 0 in 0.923s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1cd22e7-cb18-473c-9159-69e25b81de83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:57:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:25 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3 Jul 03 23:57:25 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:25 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe" returned: 0 in 1.018s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] <== create_volume: return (2379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:57:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.382s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Attempting download of 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 ((None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}])) to volume a3608be1-9819-4597-af33-392bf9ab6cbe. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 23:57:25 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[36de8ea5-2f4b-4b29-8883-a396bc47df2e]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9a6t65zc {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:26 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9a6t65zc Jul 03 23:57:26 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:26 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3" returned: 0 in 1.387s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:26 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3 Jul 03 23:57:26 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:26 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9a6t65zc" returned: 0 in 0.915s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9a6t65zc {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:27 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9a6t65zc Jul 03 23:57:27 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:27 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.3057f693-d710-4df9-8927-ca7c5e8047d3" returned: 0 in 0.976s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-quobyte-3057f693-d710-4df9-8927-ca7c5e8047d3" released by "_delete_snapshot" :: held 4.782s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-quobyte-a1cd22e7-cb18-473c-9159-69e25b81de83" released by "delete_snapshot" :: held 4.815s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:27 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] Created reservations ['be656e82-f91d-4885-b24e-5ca1b9664c25', 'fb313402-51fc-4b48-9d77-58e9e65d2169', '1a9d1db9-94ce-44b8-97e2-924228ea2e01', 'acd60d44-e176-4364-a0fc-7286c251cacd'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:57:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] Delete snapshot completed successfully. Jul 03 23:57:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fc154141-88f8-4f25-a145-dddfd3434974 tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-3057f693-d710-4df9-8927-ca7c5e8047d3-delete_snapshot" released by "delete_snapshot" :: held 5.096s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:27 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9a6t65zc" returned: 1 in 1.032s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9a6t65zc' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 23:57:27 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3ab4c2-b5c5-422d-80a3-4905c3773823]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9yopxo2ndevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:28 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9yopxo2ndevstack@QuobyteHD Jul 03 23:57:28 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fd96c1d3-1a6e-4b57-99ed-883a5f56a44d tempest-SnapshotsActionsTest-1807069848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fd96c1d3-1a6e-4b57-99ed-883a5f56a44d tempest-SnapshotsActionsTest-1807069848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fd96c1d3-1a6e-4b57-99ed-883a5f56a44d tempest-SnapshotsActionsTest-1807069848 None] Creating offline snapshot b0d20c74-6be2-48c1-ba20-ce49468b6f53 of volume a1cd22e7-cb18-473c-9159-69e25b81de83 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 23:57:28 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dd482a-1827-464f-ae42-f0c9a93bd758]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fd96c1d3-1a6e-4b57-99ed-883a5f56a44d tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:28 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9yopxo2ndevstack@QuobyteHD" returned: 0 in 0.888s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:28 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 was qcow2, converting to raw {{(pid=86676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 23:57:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9yopxo2ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:28 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9yopxo2ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe Jul 03 23:57:28 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:28 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 Jul 03 23:57:28 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:29 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fd96c1d3-1a6e-4b57-99ed-883a5f56a44d tempest-SnapshotsActionsTest-1807069848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984" returned: 0 in 0.983s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fd96c1d3-1a6e-4b57-99ed-883a5f56a44d tempest-SnapshotsActionsTest-1807069848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1cd22e7-cb18-473c-9159-69e25b81de83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:57:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fd96c1d3-1a6e-4b57-99ed-883a5f56a44d tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:29 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53 1G Jul 03 23:57:29 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:30 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fd96c1d3-1a6e-4b57-99ed-883a5f56a44d tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53 1G" returned: 0 in 1.111s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fd96c1d3-1a6e-4b57-99ed-883a5f56a44d tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:30 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53 Jul 03 23:57:30 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:31 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9yopxo2ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe" returned: 0 in 2.436s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:31 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_9yopxo2ndevstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 23:57:31 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Converted 112.00 MB image at 45.94 MB/s Jul 03 23:57:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:31 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe 1G Jul 03 23:57:31 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:31 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fd96c1d3-1a6e-4b57-99ed-883a5f56a44d tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53" returned: 0 in 0.865s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:31 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-fd96c1d3-1a6e-4b57-99ed-883a5f56a44d tempest-SnapshotsActionsTest-1807069848 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53 is being set with open permissions: ugo+rw Jul 03 23:57:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fd96c1d3-1a6e-4b57-99ed-883a5f56a44d tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:31 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53 Jul 03 23:57:31 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:32 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe 1G" returned: 0 in 0.859s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:32 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f547a04-efdf-454b-9338-e53fe69efb9f]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:32 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe Jul 03 23:57:32 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:32 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fd96c1d3-1a6e-4b57-99ed-883a5f56a44d tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53" returned: 0 in 0.815s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fd96c1d3-1a6e-4b57-99ed-883a5f56a44d tempest-SnapshotsActionsTest-1807069848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.923s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:32 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fd96c1d3-1a6e-4b57-99ed-883a5f56a44d tempest-SnapshotsActionsTest-1807069848 None] Create snapshot completed successfully Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] Acquiring lock "cinder-b0d20c74-6be2-48c1-ba20-ce49468b6f53-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-b0d20c74-6be2-48c1-ba20-ce49468b6f53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] Acquiring lock "cinder-quobyte-a1cd22e7-cb18-473c-9159-69e25b81de83" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-quobyte-a1cd22e7-cb18-473c-9159-69e25b81de83" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] Acquiring lock "cinder-quobyte-b0d20c74-6be2-48c1-ba20-ce49468b6f53" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-quobyte-b0d20c74-6be2-48c1-ba20-ce49468b6f53" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] Deleting offline snapshot b0d20c74-6be2-48c1-ba20-ce49468b6f53 of volume a1cd22e7-cb18-473c-9159-69e25b81de83 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 23:57:33 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] snapshot_file for this snap is: volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe" returned: 0 in 0.969s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a14efc-2a40-4635-a21d-83f565643431]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Flow 'volume_create_manager' (e5ac323a-fec3-4905-852e-adc0a946f7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d265a73-cb32-4659-95d2-74ee3945f4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d265a73-cb32-4659-95d2-74ee3945f4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1436891115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22424820-bb1f-42ef-8d84-8ad955acfe50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5911e20c75b465eb7f5907aa1d0c60e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:33Z,use_quota=True,user_id='cb1d7653666f4a7e9b4d8326abf7d648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:33 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe Jul 03 23:57:33 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b7c09d-c03d-42b3-b0cd-05f3b79d2063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b7c09d-c03d-42b3-b0cd-05f3b79d2063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef72eee6-aca4-4513-b42a-f14bef9a9b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef72eee6-aca4-4513-b42a-f14bef9a9b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22424820-bb1f-42ef-8d84-8ad955acfe50', 'volume_name': 'volume-22424820-bb1f-42ef-8d84-8ad955acfe50', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2623a3eb-c9ae-40e6-ae1d-a2b302f9a96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2623a3eb-c9ae-40e6-ae1d-a2b302f9a96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:33 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53 Jul 03 23:57:33 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f66d92-e0f8-44cc-ad5f-462f1082303a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:33 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Volume 22424820-bb1f-42ef-8d84-8ad955acfe50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22424820-bb1f-42ef-8d84-8ad955acfe50', 'volume_size': 1} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1436891115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22424820-bb1f-42ef-8d84-8ad955acfe50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5911e20c75b465eb7f5907aa1d0c60e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:33Z,use_quota=True,user_id='cb1d7653666f4a7e9b4d8326abf7d648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Creating volume 22424820-bb1f-42ef-8d84-8ad955acfe50 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:57:33 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22424820-bb1f-42ef-8d84-8ad955acfe50 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:33 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22424820-bb1f-42ef-8d84-8ad955acfe50 1073741824 Jul 03 23:57:33 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:33 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:57:33 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:34 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.849s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 03 23:57:34 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe" returned: 1 in 1.100s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Downloaded image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 ((None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}])) to volume a3608be1-9819-4597-af33-392bf9ab6cbe successfully. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Temporary image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 for user 4f5c20e06ff749a0aa5706c46c658983 is deleted. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Marking volume a3608be1-9819-4597-af33-392bf9ab6cbe as bootable. {{(pid=86676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Copying metadata from image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 to a3608be1-9819-4597-af33-392bf9ab6cbe. {{(pid=86676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Creating volume glance metadata for volume a3608be1-9819-4597-af33-392bf9ab6cbe backed by image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 23:57:34 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53" returned: 0 in 1.215s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1cd22e7-cb18-473c-9159-69e25b81de83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3963d7a-1959-49eb-af4c-31d966951c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3608be1-9819-4597-af33-392bf9ab6cbe', 'volume_size': 1, 'image_id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47a94a0f3bea4708b842e25ca5b22b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2a8835-ff30-4d24-a0e7-8b0d1dbe1041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29fcb7d-8829-4838-be00-ef20156b5a8e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:34 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22424820-bb1f-42ef-8d84-8ad955acfe50 1073741824" returned: 0 in 1.105s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:34 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Volume volume-a3608be1-9819-4597-af33-392bf9ab6cbe (a3608be1-9819-4597-af33-392bf9ab6cbe): created successfully Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2a8835-ff30-4d24-a0e7-8b0d1dbe1041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Flow 'volume_create_manager' (2100da11-f915-4504-82cf-019e520b4ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:57:34 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2740eaac-9c55-4607-9cca-e86a80d115f5 tempest-VolumesExtendTest-1016302075 None] Created volume successfully. Jul 03 23:57:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22424820-bb1f-42ef-8d84-8ad955acfe50 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:34 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 Jul 03 23:57:34 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:34 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22424820-bb1f-42ef-8d84-8ad955acfe50 Jul 03 23:57:34 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-82fd2d77-c46f-432f-8ef9-76170110fb33 tempest-VolumesExtendTest-1016302075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:35 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22424820-bb1f-42ef-8d84-8ad955acfe50" returned: 0 in 0.756s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:57:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-82fd2d77-c46f-432f-8ef9-76170110fb33 tempest-VolumesExtendTest-1016302075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.169s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f66d92-e0f8-44cc-ad5f-462f1082303a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22424820-bb1f-42ef-8d84-8ad955acfe50', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49170893-bbb4-438f-8802-d5aa9fdf10bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:35 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Volume volume-22424820-bb1f-42ef-8d84-8ad955acfe50 (22424820-bb1f-42ef-8d84-8ad955acfe50): created successfully Jul 03 23:57:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49170893-bbb4-438f-8802-d5aa9fdf10bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Flow 'volume_create_manager' (e5ac323a-fec3-4905-852e-adc0a946f7d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:57:35 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[531588e6-d8e9-4bfb-9e34-be0e212fdf35]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-82fd2d77-c46f-432f-8ef9-76170110fb33 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:35 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5b98985b-8968-4301-a361-9dfc0ec26973 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Created volume successfully. Jul 03 23:57:35 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984" returned: 0 in 0.963s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1cd22e7-cb18-473c-9159-69e25b81de83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:57:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:35 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53 Jul 03 23:57:35 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:35 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe Jul 03 23:57:35 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:36 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-82fd2d77-c46f-432f-8ef9-76170110fb33 tempest-VolumesExtendTest-1016302075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe" returned: 0 in 0.758s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-82fd2d77-c46f-432f-8ef9-76170110fb33 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:36 devstack sudo[95648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe Jul 03 23:57:36 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:36 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53" returned: 0 in 0.833s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:36 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53 Jul 03 23:57:36 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:36 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-82fd2d77-c46f-432f-8ef9-76170110fb33 tempest-VolumesExtendTest-1016302075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe" returned: 1 in 0.827s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-82fd2d77-c46f-432f-8ef9-76170110fb33 tempest-VolumesExtendTest-1016302075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 23:57:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-82fd2d77-c46f-432f-8ef9-76170110fb33 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe 2G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:36 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.b0d20c74-6be2-48c1-ba20-ce49468b6f53" returned: 0 in 0.703s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-quobyte-b0d20c74-6be2-48c1-ba20-ce49468b6f53" released by "_delete_snapshot" :: held 3.865s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-quobyte-a1cd22e7-cb18-473c-9159-69e25b81de83" released by "delete_snapshot" :: held 3.890s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-82fd2d77-c46f-432f-8ef9-76170110fb33 tempest-VolumesExtendTest-1016302075 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe 2G" returned: 0 in 0.078s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-82fd2d77-c46f-432f-8ef9-76170110fb33 tempest-VolumesExtendTest-1016302075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.717s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:37 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-82fd2d77-c46f-432f-8ef9-76170110fb33 tempest-VolumesExtendTest-1016302075 None] Extend volume completed successfully. Jul 03 23:57:37 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] Created reservations ['1104b1cb-d46f-4e99-bd39-f97d5c25746c', '433c1ff0-6b88-428c-b861-38af36d923c0', 'ff3d090b-3f9a-4689-9641-10737d800f07', 'fe18492a-0565-4cda-8c3d-46c90584cba4'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:57:37 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] Delete snapshot completed successfully. Jul 03 23:57:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-938e353c-9901-4b31-a621-d5ababa68ddc tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-b0d20c74-6be2-48c1-ba20-ce49468b6f53-delete_snapshot" released by "delete_snapshot" :: held 4.083s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Acquiring lock "cinder-22424820-bb1f-42ef-8d84-8ad955acfe50-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Lock "cinder-22424820-bb1f-42ef-8d84-8ad955acfe50-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Acquiring lock "cinder-quobyte-22424820-bb1f-42ef-8d84-8ad955acfe50" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] Acquiring lock "cinder-a3608be1-9819-4597-af33-392bf9ab6cbe-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Lock "cinder-quobyte-22424820-bb1f-42ef-8d84-8ad955acfe50" acquired by "delete_volume" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] Lock "cinder-a3608be1-9819-4597-af33-392bf9ab6cbe-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:37 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f456ba5-9a3e-4bba-be38-640db6e50cac]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22424820-bb1f-42ef-8d84-8ad955acfe50 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] Acquiring lock "cinder-quobyte-a3608be1-9819-4597-af33-392bf9ab6cbe" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] Lock "cinder-quobyte-a3608be1-9819-4597-af33-392bf9ab6cbe" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:37 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fded830-13ed-4157-9f65-56db2beaae7c]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:37 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22424820-bb1f-42ef-8d84-8ad955acfe50 Jul 03 23:57:37 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:37 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe Jul 03 23:57:37 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1d24a402-d989-4b53-b2a6-4aab76ed5588 tempest-SnapshotsActionsTest-1807069848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1d24a402-d989-4b53-b2a6-4aab76ed5588 tempest-SnapshotsActionsTest-1807069848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1d24a402-d989-4b53-b2a6-4aab76ed5588 tempest-SnapshotsActionsTest-1807069848 None] Creating offline snapshot 078c02d9-998a-4e72-b733-e4de05234a5a of volume a1cd22e7-cb18-473c-9159-69e25b81de83 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 23:57:38 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5977004d-1abf-440a-99d5-ec4a6d2aba59]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d24a402-d989-4b53-b2a6-4aab76ed5588 tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:38 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 Jul 03 23:57:38 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:38 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22424820-bb1f-42ef-8d84-8ad955acfe50" returned: 0 in 1.245s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22424820-bb1f-42ef-8d84-8ad955acfe50 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:38 devstack sudo[95673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22424820-bb1f-42ef-8d84-8ad955acfe50 Jul 03 23:57:38 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:38 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe" returned: 0 in 1.191s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:39 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe Jul 03 23:57:39 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:39 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d24a402-d989-4b53-b2a6-4aab76ed5588 tempest-SnapshotsActionsTest-1807069848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984" returned: 0 in 1.364s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1d24a402-d989-4b53-b2a6-4aab76ed5588 tempest-SnapshotsActionsTest-1807069848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1cd22e7-cb18-473c-9159-69e25b81de83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:57:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d24a402-d989-4b53-b2a6-4aab76ed5588 tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:39 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a 1G Jul 03 23:57:39 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:39 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe" returned: 1 in 1.018s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 23:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:40 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe Jul 03 23:57:40 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:40 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-22424820-bb1f-42ef-8d84-8ad955acfe50" returned: 0 in 1.240s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Lock "cinder-quobyte-22424820-bb1f-42ef-8d84-8ad955acfe50" released by "delete_volume" :: held 2.564s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:40 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Created reservations ['9d4742eb-64ff-42ba-8b83-07d4f927a467', 'b5488a97-f18b-4787-b552-a2f3c0fab6d0', '86c6c4eb-92c2-4652-81a5-209938d6335e', 'c04b7f20-fb47-4da9-b882-95b049cbb593'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:57:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:40 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:57:40 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:40 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a3608be1-9819-4597-af33-392bf9ab6cbe" returned: 0 in 0.782s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] Lock "cinder-quobyte-a3608be1-9819-4597-af33-392bf9ab6cbe" released by "delete_volume" :: held 3.093s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:40 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d24a402-d989-4b53-b2a6-4aab76ed5588 tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a 1G" returned: 0 in 1.372s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d24a402-d989-4b53-b2a6-4aab76ed5588 tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:40 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] Created reservations ['922dcc41-7bd1-4304-9468-e2c8e7fec252', '31f14214-0e2f-4f72-9172-fecae7ed3c97', '344227be-de0c-41cc-a646-759cd16e1c46', 'df96cc35-0ec0-4ed5-9d13-9606b1b96506'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:57:40 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a Jul 03 23:57:40 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:57:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:57:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:41 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:57:41 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:41 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.918s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:41 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:57:41 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Deleted volume successfully. Jul 03 23:57:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0fdd27e2-385f-4007-a8f6-4c4b58a38e75 tempest-VolumeQuotasNegativeTestJSON-252765414 None] Lock "cinder-22424820-bb1f-42ef-8d84-8ad955acfe50-delete_volume" released by "delete_volume" :: held 3.794s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:41 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:57:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Flow 'volume_create_manager' (48d76223-d2e3-486b-946a-b063eedae567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:57:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd59c006-113e-49a5-9d17-288bbb943b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd59c006-113e-49a5-9d17-288bbb943b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1146393298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31671a164582493089d47ca17878b558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:42Z,use_quota=True,user_id='4f5c20e06ff749a0aa5706c46c658983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e5c2f3-b7a3-475f-a2a8-cf82f2dc2da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e5c2f3-b7a3-475f-a2a8-cf82f2dc2da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4cb3a3-8281-41e0-a5c9-716b94a47c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4cb3a3-8281-41e0-a5c9-716b94a47c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6', 'volume_name': 'volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c02e2d-58bf-4d7c-b890-856ef051e448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c02e2d-58bf-4d7c-b890-856ef051e448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15456bcf-72a4-47ca-8fcc-40362ec85a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:42 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Volume 8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6', 'volume_size': 1} Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:42 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d24a402-d989-4b53-b2a6-4aab76ed5588 tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a" returned: 0 in 1.183s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:42 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-1d24a402-d989-4b53-b2a6-4aab76ed5588 tempest-SnapshotsActionsTest-1807069848 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a is being set with open permissions: ugo+rw Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d24a402-d989-4b53-b2a6-4aab76ed5588 tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:42 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a Jul 03 23:57:42 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:42 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.182s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:57:42 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] Deleted volume successfully. Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ab96a6dc-0738-431d-8d2c-4aee41cae32e tempest-VolumesExtendTest-1016302075 None] Lock "cinder-a3608be1-9819-4597-af33-392bf9ab6cbe-delete_volume" released by "delete_volume" :: held 4.623s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:42 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d24a402-d989-4b53-b2a6-4aab76ed5588 tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a" returned: 0 in 0.771s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1d24a402-d989-4b53-b2a6-4aab76ed5588 tempest-SnapshotsActionsTest-1807069848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.904s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.862s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1146393298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31671a164582493089d47ca17878b558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:42Z,use_quota=True,user_id='4f5c20e06ff749a0aa5706c46c658983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Creating volume 8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:57:42 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:57:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:42 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 1073741824 Jul 03 23:57:42 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:42 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1d24a402-d989-4b53-b2a6-4aab76ed5588 tempest-SnapshotsActionsTest-1807069848 None] Create snapshot completed successfully Jul 03 23:57:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] Acquiring lock "cinder-078c02d9-998a-4e72-b733-e4de05234a5a-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-078c02d9-998a-4e72-b733-e4de05234a5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] Acquiring lock "cinder-quobyte-a1cd22e7-cb18-473c-9159-69e25b81de83" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-quobyte-a1cd22e7-cb18-473c-9159-69e25b81de83" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] Acquiring lock "cinder-quobyte-078c02d9-998a-4e72-b733-e4de05234a5a" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-quobyte-078c02d9-998a-4e72-b733-e4de05234a5a" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] Deleting offline snapshot 078c02d9-998a-4e72-b733-e4de05234a5a of volume a1cd22e7-cb18-473c-9159-69e25b81de83 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 23:57:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] snapshot_file for this snap is: volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 23:57:43 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30f2bc1-d876-45ea-bd14-b70de651e587]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:44 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a Jul 03 23:57:44 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:44 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 1073741824" returned: 0 in 1.349s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:44 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 Jul 03 23:57:44 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:45 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a" returned: 0 in 1.274s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1cd22e7-cb18-473c-9159-69e25b81de83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:57:45 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd86d29-e49c-426d-b20b-c2c2884c87aa]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:45 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 Jul 03 23:57:45 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:45 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6" returned: 0 in 0.945s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] <== create_volume: return (2371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:57:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.378s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15456bcf-72a4-47ca-8fcc-40362ec85a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668bae0f-ac95-4f83-aa42-87f514d846ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:45 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Volume volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 (8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6): created successfully Jul 03 23:57:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668bae0f-ac95-4f83-aa42-87f514d846ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Flow 'volume_create_manager' (48d76223-d2e3-486b-946a-b063eedae567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:57:45 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-92586a27-af0d-4571-a288-d574aa299da3 tempest-VolumesExtendTest-1016302075 None] Created volume successfully. Jul 03 23:57:46 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984" returned: 0 in 0.965s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1cd22e7-cb18-473c-9159-69e25b81de83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:57:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:46 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a Jul 03 23:57:46 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-777864ef-d24d-4b48-b805-6994065da810 tempest-VolumesExtendTest-1016302075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-777864ef-d24d-4b48-b805-6994065da810 tempest-VolumesExtendTest-1016302075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-777864ef-d24d-4b48-b805-6994065da810 tempest-VolumesExtendTest-1016302075 None] Creating offline snapshot f28abcfb-2dca-4b89-824e-e03ff2cd797f of volume 8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 23:57:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4480083c-0096-41ad-be96-316fe41e24c1]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-777864ef-d24d-4b48-b805-6994065da810 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:46 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 Jul 03 23:57:46 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:47 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a" returned: 0 in 1.271s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:47 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a Jul 03 23:57:47 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:47 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-777864ef-d24d-4b48-b805-6994065da810 tempest-VolumesExtendTest-1016302075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6" returned: 0 in 1.268s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-777864ef-d24d-4b48-b805-6994065da810 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:47 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f 1G Jul 03 23:57:47 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:48 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.078c02d9-998a-4e72-b733-e4de05234a5a" returned: 0 in 0.979s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-quobyte-078c02d9-998a-4e72-b733-e4de05234a5a" released by "_delete_snapshot" :: held 4.654s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-quobyte-a1cd22e7-cb18-473c-9159-69e25b81de83" released by "delete_snapshot" :: held 4.713s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-971088c9-a024-428a-8711-ba2f4a072977 tempest-VolumesActionsTest-1510068861 None] Acquiring lock "cinder-b6276e00-46ee-4fe5-9483-7d1510813254" by "attach_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-971088c9-a024-428a-8711-ba2f4a072977 tempest-VolumesActionsTest-1510068861 None] Lock "cinder-b6276e00-46ee-4fe5-9483-7d1510813254" acquired by "attach_volume" :: waited 0.040s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:48 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] Created reservations ['df311933-1e75-4d1e-ac83-9f340af5e799', '382826ea-12b9-4f47-803c-3892e757d893', '688f6329-018f-4bf4-aeb7-1c520fe51c72', '7c1c59d1-cebc-40db-89c6-803c8b129a4f'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:57:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-971088c9-a024-428a-8711-ba2f4a072977 tempest-VolumesActionsTest-1510068861 None] Attaching volume b6276e00-46ee-4fe5-9483-7d1510813254 to instance e4ea6e1d-b4ea-4fd0-98a3-af0398d490d3 at mountpoint /dev/vdb on host None. Jul 03 23:57:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] Delete snapshot completed successfully. Jul 03 23:57:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c21a25a6-413f-4a7c-a9f0-51074296aa30 tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-078c02d9-998a-4e72-b733-e4de05234a5a-delete_snapshot" released by "delete_snapshot" :: held 5.132s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-971088c9-a024-428a-8711-ba2f4a072977 tempest-VolumesActionsTest-1510068861 None] Attach volume completed successfully. Jul 03 23:57:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-971088c9-a024-428a-8711-ba2f4a072977 tempest-VolumesActionsTest-1510068861 None] Lock "cinder-b6276e00-46ee-4fe5-9483-7d1510813254" released by "attach_volume" :: held 0.192s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:49 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-777864ef-d24d-4b48-b805-6994065da810 tempest-VolumesExtendTest-1016302075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f 1G" returned: 0 in 1.497s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-777864ef-d24d-4b48-b805-6994065da810 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:49 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f Jul 03 23:57:49 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-777b5449-9442-4180-a95a-afdd2f25378e tempest-VolumesActionsTest-1510068861 None] Acquiring lock "cinder-b6276e00-46ee-4fe5-9483-7d1510813254-detach_volume" by "detach_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-777b5449-9442-4180-a95a-afdd2f25378e tempest-VolumesActionsTest-1510068861 None] Lock "cinder-b6276e00-46ee-4fe5-9483-7d1510813254-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:49 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-777b5449-9442-4180-a95a-afdd2f25378e tempest-VolumesActionsTest-1510068861 None] Detaching volume b6276e00-46ee-4fe5-9483-7d1510813254 from instance e4ea6e1d-b4ea-4fd0-98a3-af0398d490d3. Jul 03 23:57:49 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-777b5449-9442-4180-a95a-afdd2f25378e tempest-VolumesActionsTest-1510068861 None] Detach volume completed successfully. Jul 03 23:57:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-777b5449-9442-4180-a95a-afdd2f25378e tempest-VolumesActionsTest-1510068861 None] Lock "cinder-b6276e00-46ee-4fe5-9483-7d1510813254-detach_volume" released by "detach_volume" :: held 0.144s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:49 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:57:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Flow 'volume_create_manager' (8b2a741b-0061-4d3a-9017-cb723a1928a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:57:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3cf829-71f0-4759-a196-bb8f30849e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3cf829-71f0-4759-a196-bb8f30849e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-241049019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cf3def1-8cb6-49ca-b329-44876b195a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b13bf3ed93f34115a4ba316968d21528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:49Z,use_quota=True,user_id='1ea5bbcb56e44771a8e76e5dcf3665b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9389a3b7-2378-4b13-b8c8-65755aa9d62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9389a3b7-2378-4b13-b8c8-65755aa9d62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb806c48-8dcf-4069-b69e-b6246bdda7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb806c48-8dcf-4069-b69e-b6246bdda7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cf3def1-8cb6-49ca-b329-44876b195a04', 'volume_name': 'volume-8cf3def1-8cb6-49ca-b329-44876b195a04', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0311a813-c2c1-48e1-a359-8f2cbb7491c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0311a813-c2c1-48e1-a359-8f2cbb7491c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cf9e26-72d8-4b28-bbb3-08a0d0bd8b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:49 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Volume 8cf3def1-8cb6-49ca-b329-44876b195a04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cf3def1-8cb6-49ca-b329-44876b195a04', 'volume_size': 1} Jul 03 23:57:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dc9ae030-7c71-421c-8d19-2753fbd3135a tempest-SnapshotsActionsTest-1807069848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:50 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-777864ef-d24d-4b48-b805-6994065da810 tempest-VolumesExtendTest-1016302075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f" returned: 0 in 1.011s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:50 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-777864ef-d24d-4b48-b805-6994065da810 tempest-VolumesExtendTest-1016302075 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f is being set with open permissions: ugo+rw Jul 03 23:57:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-777864ef-d24d-4b48-b805-6994065da810 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:50 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f Jul 03 23:57:50 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:50 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-777864ef-d24d-4b48-b805-6994065da810 tempest-VolumesExtendTest-1016302075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f" returned: 0 in 0.687s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-777864ef-d24d-4b48-b805-6994065da810 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:51 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.info Jul 03 23:57:51 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:51 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-777864ef-d24d-4b48-b805-6994065da810 tempest-VolumesExtendTest-1016302075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.info" returned: 0 in 0.668s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:51 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-777864ef-d24d-4b48-b805-6994065da810 tempest-VolumesExtendTest-1016302075 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.info is being set with open permissions: ugo+rw Jul 03 23:57:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-777864ef-d24d-4b48-b805-6994065da810 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:51 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.info Jul 03 23:57:51 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:52 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-777864ef-d24d-4b48-b805-6994065da810 tempest-VolumesExtendTest-1016302075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.info" returned: 0 in 0.770s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-777864ef-d24d-4b48-b805-6994065da810 tempest-VolumesExtendTest-1016302075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.033s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.740s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-241049019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cf3def1-8cb6-49ca-b329-44876b195a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b13bf3ed93f34115a4ba316968d21528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:49Z,use_quota=True,user_id='1ea5bbcb56e44771a8e76e5dcf3665b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:57:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Creating volume 8cf3def1-8cb6-49ca-b329-44876b195a04 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:57:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:57:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:57:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:57:52 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:57:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8cf3def1-8cb6-49ca-b329-44876b195a04 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:52 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8cf3def1-8cb6-49ca-b329-44876b195a04 1073741824 Jul 03 23:57:52 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:52 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-777864ef-d24d-4b48-b805-6994065da810 tempest-VolumesExtendTest-1016302075 None] Create snapshot completed successfully Jul 03 23:57:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cc6db729-31a0-4f2f-a1e9-b2e36e1fecdf tempest-VolumesExtendTest-1016302075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:53 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8cf3def1-8cb6-49ca-b329-44876b195a04 1073741824" returned: 0 in 0.927s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8cf3def1-8cb6-49ca-b329-44876b195a04 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:53 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8cf3def1-8cb6-49ca-b329-44876b195a04 Jul 03 23:57:53 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:54 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8cf3def1-8cb6-49ca-b329-44876b195a04" returned: 0 in 0.671s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:57:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dc9ae030-7c71-421c-8d19-2753fbd3135a tempest-SnapshotsActionsTest-1807069848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.369s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-dc9ae030-7c71-421c-8d19-2753fbd3135a tempest-SnapshotsActionsTest-1807069848 None] Creating offline snapshot 58e4c4af-a448-4b65-97ec-fb20818c1962 of volume a1cd22e7-cb18-473c-9159-69e25b81de83 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 23:57:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cf9e26-72d8-4b28-bbb3-08a0d0bd8b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cf3def1-8cb6-49ca-b329-44876b195a04', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f11e8fa-171e-478f-8330-029f1fc51090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:57:54 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e9106e-5bfa-42fa-b70e-b3746ffcde63]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dc9ae030-7c71-421c-8d19-2753fbd3135a tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:54 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Volume volume-8cf3def1-8cb6-49ca-b329-44876b195a04 (8cf3def1-8cb6-49ca-b329-44876b195a04): created successfully Jul 03 23:57:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f11e8fa-171e-478f-8330-029f1fc51090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:57:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Flow 'volume_create_manager' (8b2a741b-0061-4d3a-9017-cb723a1928a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:57:54 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-14fc7562-33df-44cc-8bd6-c9efefcfbc20 tempest-VolumesServicesTestJSON-1003233141 None] Created volume successfully. Jul 03 23:57:54 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 Jul 03 23:57:54 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:55 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dc9ae030-7c71-421c-8d19-2753fbd3135a tempest-SnapshotsActionsTest-1807069848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984" returned: 0 in 0.828s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-dc9ae030-7c71-421c-8d19-2753fbd3135a tempest-SnapshotsActionsTest-1807069848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1cd22e7-cb18-473c-9159-69e25b81de83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:57:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dc9ae030-7c71-421c-8d19-2753fbd3135a tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:55 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962 1G Jul 03 23:57:55 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] Acquiring lock "cinder-8cf3def1-8cb6-49ca-b329-44876b195a04-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] Lock "cinder-8cf3def1-8cb6-49ca-b329-44876b195a04-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] Acquiring lock "cinder-quobyte-8cf3def1-8cb6-49ca-b329-44876b195a04" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] Lock "cinder-quobyte-8cf3def1-8cb6-49ca-b329-44876b195a04" acquired by "delete_volume" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:55 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc93bbf-face-4999-b01b-1c9990988887]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8cf3def1-8cb6-49ca-b329-44876b195a04 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:55 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8cf3def1-8cb6-49ca-b329-44876b195a04 Jul 03 23:57:55 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:55 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dc9ae030-7c71-421c-8d19-2753fbd3135a tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962 1G" returned: 0 in 0.919s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dc9ae030-7c71-421c-8d19-2753fbd3135a tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:55 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962 Jul 03 23:57:55 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:56 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8cf3def1-8cb6-49ca-b329-44876b195a04" returned: 0 in 0.828s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8cf3def1-8cb6-49ca-b329-44876b195a04 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:56 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8cf3def1-8cb6-49ca-b329-44876b195a04 Jul 03 23:57:56 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:56 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dc9ae030-7c71-421c-8d19-2753fbd3135a tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962" returned: 0 in 0.741s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:56 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-dc9ae030-7c71-421c-8d19-2753fbd3135a tempest-SnapshotsActionsTest-1807069848 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962 is being set with open permissions: ugo+rw Jul 03 23:57:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dc9ae030-7c71-421c-8d19-2753fbd3135a tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:56 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962 Jul 03 23:57:56 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:56 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8cf3def1-8cb6-49ca-b329-44876b195a04" returned: 0 in 0.710s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] Lock "cinder-quobyte-8cf3def1-8cb6-49ca-b329-44876b195a04" released by "delete_volume" :: held 1.587s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:56 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=104,cinder:INSERT=34,cinder:UPDATE=107,cinder:DELETE=10 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:57:56 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:INSERT=30,cinder:UPDATE=110,cinder:SELECT=96,cinder:DELETE=10 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:57:57 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] Created reservations ['4de61538-38f3-4dae-8317-95a11eeee9a7', '5b1da7af-b69e-4e05-9ad8-dd6da9cd462c', 'a538b02d-dce4-4720-82d1-e3a9dd3807d6', 'cfb14390-f368-428d-a4be-83d1d2533626'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:57:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:57:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:57:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:57 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:57:57 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:57 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dc9ae030-7c71-421c-8d19-2753fbd3135a tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962" returned: 0 in 0.698s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dc9ae030-7c71-421c-8d19-2753fbd3135a tempest-SnapshotsActionsTest-1807069848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.326s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cc6db729-31a0-4f2f-a1e9-b2e36e1fecdf tempest-VolumesExtendTest-1016302075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 4.418s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:57 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f16c850-a0cf-4509-98b0-4acbb71e86a8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cc6db729-31a0-4f2f-a1e9-b2e36e1fecdf tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-dc9ae030-7c71-421c-8d19-2753fbd3135a tempest-SnapshotsActionsTest-1807069848 None] Create snapshot completed successfully Jul 03 23:57:57 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 Jul 03 23:57:57 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:57 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.750s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:57 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:57:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] Deleted volume successfully. Jul 03 23:57:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-17c7a9ab-cfdc-4ac6-8505-908d3cbdc5a2 tempest-VolumesServicesTestJSON-1003233141 None] Lock "cinder-8cf3def1-8cb6-49ca-b329-44876b195a04-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:57:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] Acquiring lock "cinder-58e4c4af-a448-4b65-97ec-fb20818c1962-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-58e4c4af-a448-4b65-97ec-fb20818c1962-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] Acquiring lock "cinder-quobyte-a1cd22e7-cb18-473c-9159-69e25b81de83" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-quobyte-a1cd22e7-cb18-473c-9159-69e25b81de83" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] Acquiring lock "cinder-quobyte-58e4c4af-a448-4b65-97ec-fb20818c1962" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-quobyte-58e4c4af-a448-4b65-97ec-fb20818c1962" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] Deleting offline snapshot 58e4c4af-a448-4b65-97ec-fb20818c1962 of volume a1cd22e7-cb18-473c-9159-69e25b81de83 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 23:57:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] snapshot_file for this snap is: volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 23:57:58 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8219221b-e849-495e-86fa-a67cedc979db]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:58 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962 Jul 03 23:57:58 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:58 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cc6db729-31a0-4f2f-a1e9-b2e36e1fecdf tempest-VolumesExtendTest-1016302075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6" returned: 0 in 1.113s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cc6db729-31a0-4f2f-a1e9-b2e36e1fecdf tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f 2G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cc6db729-31a0-4f2f-a1e9-b2e36e1fecdf tempest-VolumesExtendTest-1016302075 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f 2G" returned: 0 in 0.172s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cc6db729-31a0-4f2f-a1e9-b2e36e1fecdf tempest-VolumesExtendTest-1016302075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.349s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:57:58 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-cc6db729-31a0-4f2f-a1e9-b2e36e1fecdf tempest-VolumesExtendTest-1016302075 None] Extend volume completed successfully. Jul 03 23:57:59 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Jul 03 23:57:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962" returned: 0 in 0.958s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:57:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1cd22e7-cb18-473c-9159-69e25b81de83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:57:59 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[186110cf-aa26-4cb3-a02e-b937f6f58873]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:59 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 Jul 03 23:57:59 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:57:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] Acquiring lock "cinder-f28abcfb-2dca-4b89-824e-e03ff2cd797f-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] Lock "cinder-f28abcfb-2dca-4b89-824e-e03ff2cd797f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] Acquiring lock "cinder-quobyte-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] Lock "cinder-quobyte-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] Acquiring lock "cinder-quobyte-f28abcfb-2dca-4b89-824e-e03ff2cd797f" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:57:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] Lock "cinder-quobyte-f28abcfb-2dca-4b89-824e-e03ff2cd797f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:57:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] Deleting offline snapshot f28abcfb-2dca-4b89-824e-e03ff2cd797f of volume 8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 23:57:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] snapshot_file for this snap is: volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 23:57:59 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7949b15-cd9f-4666-9036-97045e9bbac7]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:57:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d498fb10-cca9-4518-84a5-eccb6badcc36 tempest-VolumesActionsTest-1510068861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:57:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d498fb10-cca9-4518-84a5-eccb6badcc36 tempest-VolumesActionsTest-1510068861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:57:59 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[062b1b8f-4977-45b6-9f7d-2edd06d648a4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:57:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d498fb10-cca9-4518-84a5-eccb6badcc36 tempest-VolumesActionsTest-1510068861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:00 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f Jul 03 23:58:00 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:00 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 Jul 03 23:58:00 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:00 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984" returned: 0 in 1.026s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1cd22e7-cb18-473c-9159-69e25b81de83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:58:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:00 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962 Jul 03 23:58:00 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:00 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f" returned: 0 in 1.045s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:58:00 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaf53bd-7af9-4774-905b-ec13b0ff019e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:58:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:01 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d498fb10-cca9-4518-84a5-eccb6badcc36 tempest-VolumesActionsTest-1510068861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254" returned: 0 in 1.078s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:01 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[577fcc1f-9e96-4f7d-8d5a-62d3636a1886]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:58:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d498fb10-cca9-4518-84a5-eccb6badcc36 tempest-VolumesActionsTest-1510068861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:01 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 Jul 03 23:58:01 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:01 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 Jul 03 23:58:01 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:01 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962" returned: 0 in 0.952s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:01 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962 Jul 03 23:58:01 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:01 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6" returned: 0 in 0.917s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:01 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f Jul 03 23:58:01 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:01 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d498fb10-cca9-4518-84a5-eccb6badcc36 tempest-VolumesActionsTest-1510068861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254" returned: 0 in 0.941s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d498fb10-cca9-4518-84a5-eccb6badcc36 tempest-VolumesActionsTest-1510068861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 /opt/stack/data/cinder/conversion/b6276e00-46ee-4fe5-9483-7d1510813254.temp_image.7f435bd1-7177-4a19-93c1-03e5d76578dcfjtaezeg.img {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:02 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 /opt/stack/data/cinder/conversion/b6276e00-46ee-4fe5-9483-7d1510813254.temp_image.7f435bd1-7177-4a19-93c1-03e5d76578dcfjtaezeg.img Jul 03 23:58:02 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:02 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.58e4c4af-a448-4b65-97ec-fb20818c1962" returned: 0 in 0.871s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-quobyte-58e4c4af-a448-4b65-97ec-fb20818c1962" released by "_delete_snapshot" :: held 3.930s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:58:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-quobyte-a1cd22e7-cb18-473c-9159-69e25b81de83" released by "delete_snapshot" :: held 3.958s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:58:02 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] Created reservations ['45b36e63-c3a0-4b59-a6cf-d606fae855a3', 'db8f6c50-873f-4c31-9795-b0bfb6652e14', 'e4097d90-0cca-45b7-8849-0c92c8160b90', 'fc8c4d9a-3052-452d-92df-3268417c4a52'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:58:02 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] Delete snapshot completed successfully. Jul 03 23:58:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-84284b9e-1fdb-4a88-b159-1af798923c7e tempest-SnapshotsActionsTest-252156324 None] Lock "cinder-58e4c4af-a448-4b65-97ec-fb20818c1962-delete_snapshot" released by "delete_snapshot" :: held 4.155s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:58:03 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f" returned: 0 in 1.179s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:03 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f Jul 03 23:58:03 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] Acquiring lock "cinder-5c2a1585-a1c1-4441-acf4-2ed9e3696984-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:58:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] Lock "cinder-5c2a1585-a1c1-4441-acf4-2ed9e3696984-delete_snapshot" acquired by "delete_snapshot" :: waited 0.086s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:58:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] Acquiring lock "cinder-quobyte-a1cd22e7-cb18-473c-9159-69e25b81de83" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:58:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] Lock "cinder-quobyte-a1cd22e7-cb18-473c-9159-69e25b81de83" acquired by "delete_snapshot" :: waited 0.067s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:58:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] Acquiring lock "cinder-quobyte-5c2a1585-a1c1-4441-acf4-2ed9e3696984" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:58:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] Lock "cinder-quobyte-5c2a1585-a1c1-4441-acf4-2ed9e3696984" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:58:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] Deleting offline snapshot 5c2a1585-a1c1-4441-acf4-2ed9e3696984 of volume a1cd22e7-cb18-473c-9159-69e25b81de83 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 23:58:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] snapshot_file for this snap is: volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 23:58:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[683e21a8-a8ed-4328-8a6a-f8ebd480675f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:58:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:03 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 Jul 03 23:58:03 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:05 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6.f28abcfb-2dca-4b89-824e-e03ff2cd797f" returned: 0 in 1.922s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] Lock "cinder-quobyte-f28abcfb-2dca-4b89-824e-e03ff2cd797f" released by "_delete_snapshot" :: held 5.334s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:58:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] Lock "cinder-quobyte-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6" released by "delete_snapshot" :: held 5.391s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:58:05 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] Created reservations ['268d1dd6-a46a-4b11-8500-f1366d8fae52', 'b208af78-0528-422a-9a45-cb896a80d107', 'eef674e2-b350-40cc-8066-46024ec0fe87', 'c105af53-01f8-460d-96fc-cfc4ed70a1c9'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:58:05 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] Delete snapshot completed successfully. Jul 03 23:58:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6baad71f-9361-42aa-80db-ea3d221bcc0a tempest-VolumesExtendTest-1016302075 None] Lock "cinder-f28abcfb-2dca-4b89-824e-e03ff2cd797f-delete_snapshot" released by "delete_snapshot" :: held 5.843s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:58:05 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984" returned: 0 in 2.093s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1cd22e7-cb18-473c-9159-69e25b81de83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:58:05 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a574755-a1a4-4280-b857-d25d0506fa47]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:58:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:05 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83 Jul 03 23:58:05 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] Acquiring lock "cinder-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:58:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] Lock "cinder-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:58:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] Acquiring lock "cinder-quobyte-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:58:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] Lock "cinder-quobyte-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6" acquired by "delete_volume" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:58:06 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[065a0a57-4fbc-4329-b127-c4d21b3b28e1]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:58:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:07 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 Jul 03 23:58:07 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:07 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83" returned: 0 in 1.496s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:07 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 Jul 03 23:58:07 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:08 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d498fb10-cca9-4518-84a5-eccb6badcc36 tempest-VolumesActionsTest-1510068861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 /opt/stack/data/cinder/conversion/b6276e00-46ee-4fe5-9483-7d1510813254.temp_image.7f435bd1-7177-4a19-93c1-03e5d76578dcfjtaezeg.img" returned: 0 in 6.203s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:08 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6640ad59-a801-4e41-b2c6-6a2c27857351]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:58:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d498fb10-cca9-4518-84a5-eccb6badcc36 tempest-VolumesActionsTest-1510068861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:08 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 Jul 03 23:58:08 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:08 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6" returned: 0 in 1.518s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:08 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:08 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6 Jul 03 23:58:08 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984" returned: 0 in 1.142s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:08 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984 Jul 03 23:58:08 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:09 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6" returned: 0 in 0.752s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] Lock "cinder-quobyte-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6" released by "delete_volume" :: held 2.425s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:58:09 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] Created reservations ['ae00a0a7-bec1-4fe7-ab3f-322919944188', 'd578c735-4507-47d8-89b1-11816b1e07b9', '409eb32a-f059-4996-9c2a-0057a2cb7a26', '2a3e2407-9d8f-4784-8590-1f95391de6dd'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:58:09 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83.5c2a1585-a1c1-4441-acf4-2ed9e3696984" returned: 0 in 0.868s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] Lock "cinder-quobyte-5c2a1585-a1c1-4441-acf4-2ed9e3696984" released by "_delete_snapshot" :: held 5.833s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:58:09 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] Lock "cinder-quobyte-a1cd22e7-cb18-473c-9159-69e25b81de83" released by "delete_snapshot" :: held 5.884s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:58:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d498fb10-cca9-4518-84a5-eccb6badcc36 tempest-VolumesActionsTest-1510068861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254" returned: 0 in 1.162s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:09 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-d498fb10-cca9-4518-84a5-eccb6badcc36 tempest-VolumesActionsTest-1510068861 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/conversion/b6276e00-46ee-4fe5-9483-7d1510813254.temp_image.7f435bd1-7177-4a19-93c1-03e5d76578dcfjtaezeg.img {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 23:58:09 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-d498fb10-cca9-4518-84a5-eccb6badcc36 tempest-VolumesActionsTest-1510068861 None] Converted 1024.00 MB image at 165.05 MB/s Jul 03 23:58:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:58:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:58:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:58:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:58:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:58:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:09 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:58:09 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:09 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-d498fb10-cca9-4518-84a5-eccb6badcc36 tempest-VolumesActionsTest-1510068861 None] 7f435bd1-7177-4a19-93c1-03e5d76578dc was raw, no need to convert to raw {{(pid=86676) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 03 23:58:09 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] Created reservations ['292b08ee-b7c0-4a34-acc3-fc1edc0c4d21', 'f61b60a7-2de5-4a9e-afff-942a95a214bb', 'c209831d-6979-474b-9c2e-5ec14d33ef07', '232587f7-a6c6-4762-b2d0-ae0f1194d224'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:58:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] Delete snapshot completed successfully. Jul 03 23:58:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-94fc17ac-06cf-4f4f-a647-bd1587553ba3 tempest-SnapshotsActionsTest-1807069848 None] Lock "cinder-5c2a1585-a1c1-4441-acf4-2ed9e3696984-delete_snapshot" released by "delete_snapshot" :: held 6.289s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:58:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] Acquiring lock "cinder-a1cd22e7-cb18-473c-9159-69e25b81de83-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:58:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] Lock "cinder-a1cd22e7-cb18-473c-9159-69e25b81de83-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:58:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] Acquiring lock "cinder-quobyte-a1cd22e7-cb18-473c-9159-69e25b81de83" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:58:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] Lock "cinder-quobyte-a1cd22e7-cb18-473c-9159-69e25b81de83" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:58:10 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36d4863-3b2c-410d-99b0-ed6e25e907a8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:58:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:10 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.005s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:10 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:58:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] Deleted volume successfully. Jul 03 23:58:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d06231ce-77e8-4f02-95e3-39b9e452b0d5 tempest-VolumesExtendTest-1016302075 None] Lock "cinder-8708314b-5c8c-4866-b3e8-dcd6cdc9fcf6-delete_volume" released by "delete_volume" :: held 3.869s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:58:10 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83 Jul 03 23:58:10 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:11 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83" returned: 0 in 1.147s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:11 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83 Jul 03 23:58:11 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:12 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a1cd22e7-cb18-473c-9159-69e25b81de83" returned: 0 in 0.953s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] Lock "cinder-quobyte-a1cd22e7-cb18-473c-9159-69e25b81de83" released by "delete_volume" :: held 2.217s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:58:12 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] Created reservations ['49e5d49e-24be-4988-92b8-e71ff790a63f', '39826d4d-e2e0-4475-8404-fa1c595ca452', '0c40ba41-8637-4253-b4fd-c59706da2c5b', '5ed3dc16-6b83-4c8d-9336-aba821f1c6bd'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:58:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:58:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:58:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:58:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:58:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:58:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:12 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:58:12 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:13 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.133s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:13 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:58:13 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] Deleted volume successfully. Jul 03 23:58:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-22d9fac5-bae0-4259-bd56-f5fda4aa66b9 tempest-SnapshotsActionsTest-1807069848 None] Lock "cinder-a1cd22e7-cb18-473c-9159-69e25b81de83-delete_volume" released by "delete_volume" :: held 3.699s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:58:15 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:58:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Flow 'volume_create_manager' (9d5db902-c8b5-4f5e-957d-87ddfa36e12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:58:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35cc32f1-4ae4-4e31-a3f0-078f07e6eca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35cc32f1-4ae4-4e31-a3f0-078f07e6eca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1363711923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2fdf6a-7344-4385-8ab3-d655d50a5c7b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='602cd61f822b4619b059d9e624ee4d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:15Z,use_quota=True,user_id='86b51b7ffd314859b8a1c337647a4889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2795008-5476-4a67-80cb-3cdd71976794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2795008-5476-4a67-80cb-3cdd71976794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7779ee6b-7309-44e0-9916-23bfe43066af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7779ee6b-7309-44e0-9916-23bfe43066af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e2fdf6a-7344-4385-8ab3-d655d50a5c7b', 'volume_name': 'volume-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68166451-1f82-46b6-bff6-2b7c5ab85ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68166451-1f82-46b6-bff6-2b7c5ab85ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccbff12b-1594-4398-ab99-3fe6f4670af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:15 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Volume 6e2fdf6a-7344-4385-8ab3-d655d50a5c7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b', 'volume_size': 1} Jul 03 23:58:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:58:21 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:58:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Flow 'volume_create_manager' (8ec3daaf-cc64-4287-8a54-826a1e3eec43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:58:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492742aa-aec2-48d6-8dc2-76a6dc498e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492742aa-aec2-48d6-8dc2-76a6dc498e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1946305043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbadb966-748a-4830-89db-3d8de09af20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc78b72a5f8442b83c9b8550d33147c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:22Z,use_quota=True,user_id='737424267efc4675b4a162e56d279642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(113ff9a4-4ffa-41f4-b94d-bcff833412cd),volume_type_id=113ff9a4-4ffa-41f4-b94d-bcff833412cd)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e11a0bb-ef4d-4fff-a9fa-cd0f11b2c471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e11a0bb-ef4d-4fff-a9fa-cd0f11b2c471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c820c1-05b7-4e95-adc3-20551e0f99e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c820c1-05b7-4e95-adc3-20551e0f99e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbadb966-748a-4830-89db-3d8de09af20f', 'volume_name': 'volume-fbadb966-748a-4830-89db-3d8de09af20f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b61fe73-5a9c-4b21-b4f1-039e38e9c51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b61fe73-5a9c-4b21-b4f1-039e38e9c51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e7101a-09b1-455f-b47b-a6ff5504ba42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:22 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Volume fbadb966-748a-4830-89db-3d8de09af20f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbadb966-748a-4830-89db-3d8de09af20f', 'volume_size': 1} Jul 03 23:58:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:58:25 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=41,cinder:SELECT=32,cinder:DELETE=3,cinder:INSERT=12 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:58:31 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=38,cinder:INSERT=12,cinder:UPDATE=47,cinder:DELETE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:58:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:58:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:58:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:58:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:58:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:58:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:58:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:33 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:58:33 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d498fb10-cca9-4518-84a5-eccb6badcc36 tempest-VolumesActionsTest-1510068861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.922s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:58:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d498fb10-cca9-4518-84a5-eccb6badcc36 tempest-VolumesActionsTest-1510068861 None] Uploaded volume to glance image-id: 7f435bd1-7177-4a19-93c1-03e5d76578dc. {{(pid=86676) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Jul 03 23:58:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.381s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:58:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1363711923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2fdf6a-7344-4385-8ab3-d655d50a5c7b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='602cd61f822b4619b059d9e624ee4d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:15Z,use_quota=True,user_id='86b51b7ffd314859b8a1c337647a4889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:58:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Creating volume 6e2fdf6a-7344-4385-8ab3-d655d50a5c7b {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:58:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:58:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:58:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:58:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:58:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:58:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:58:33 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:58:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:33 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d498fb10-cca9-4518-84a5-eccb6badcc36 tempest-VolumesActionsTest-1510068861 None] Copy volume to image completed successfully. Jul 03 23:58:33 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b 1073741824 Jul 03 23:58:33 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:34 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.986s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:58:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:58:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 23:58:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 03 23:58:35 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b 1073741824" returned: 0 in 1.133s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:35 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b Jul 03 23:58:35 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:35 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b" returned: 0 in 0.840s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] <== create_volume: return (2083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:58:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.087s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:58:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.968s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:58:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1946305043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbadb966-748a-4830-89db-3d8de09af20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc78b72a5f8442b83c9b8550d33147c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:22Z,use_quota=True,user_id='737424267efc4675b4a162e56d279642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(113ff9a4-4ffa-41f4-b94d-bcff833412cd),volume_type_id=113ff9a4-4ffa-41f4-b94d-bcff833412cd)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:58:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Creating volume fbadb966-748a-4830-89db-3d8de09af20f {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:58:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:58:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:58:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:58:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:58:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:58:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:58:35 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:58:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fbadb966-748a-4830-89db-3d8de09af20f 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccbff12b-1594-4398-ab99-3fe6f4670af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:36 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fbadb966-748a-4830-89db-3d8de09af20f 1073741824 Jul 03 23:58:36 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d71a9c-72e9-4f37-92b3-a937216820b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:58:36 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Volume volume-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b (6e2fdf6a-7344-4385-8ab3-d655d50a5c7b): created successfully Jul 03 23:58:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d71a9c-72e9-4f37-92b3-a937216820b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Flow 'volume_create_manager' (9d5db902-c8b5-4f5e-957d-87ddfa36e12f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:58:36 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-194b1ad2-2ea8-435f-ae84-ebb59ae794b4 tempest-VolumesGetTest-1769109687 None] Created volume successfully. Jul 03 23:58:36 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fbadb966-748a-4830-89db-3d8de09af20f 1073741824" returned: 0 in 0.943s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fbadb966-748a-4830-89db-3d8de09af20f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:37 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fbadb966-748a-4830-89db-3d8de09af20f Jul 03 23:58:37 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:37 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fbadb966-748a-4830-89db-3d8de09af20f" returned: 0 in 0.880s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:58:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:58:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.798s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:58:37 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4fd5be-fe03-4ce4-a27b-4393e35de783]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:58:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:38 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 Jul 03 23:58:38 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e7101a-09b1-455f-b47b-a6ff5504ba42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbadb966-748a-4830-89db-3d8de09af20f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a8714a-0ce4-4ce0-b260-ce84f8d6b08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Volume volume-fbadb966-748a-4830-89db-3d8de09af20f (fbadb966-748a-4830-89db-3d8de09af20f): created successfully Jul 03 23:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a8714a-0ce4-4ce0-b260-ce84f8d6b08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Flow 'volume_create_manager' (8ec3daaf-cc64-4287-8a54-826a1e3eec43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:58:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6cedcb0d-8048-4ec0-85c6-5bd414cb6bae tempest-VolumeTypesAccessTest-328112720 None] Created volume successfully. Jul 03 23:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Flow 'volume_create_manager' (4ae8d136-386d-450e-b8cd-7ff1076b4a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfde04f6-8ddc-4846-9885-bda4de9f57a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfde04f6-8ddc-4846-9885-bda4de9f57a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:58:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-211731204',display_name='tempest-VolumesGetTest-Volume-1859080143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a85b23-26e1-411e-900b-61928c28330c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602cd61f822b4619b059d9e624ee4d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:38Z,use_quota=True,user_id='86b51b7ffd314859b8a1c337647a4889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7784e0-1d5d-44f9-8dfd-e4d9bd89229c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7784e0-1d5d-44f9-8dfd-e4d9bd89229c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e671773-bb0e-41d1-8083-ceb79ec0219c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e671773-bb0e-41d1-8083-ceb79ec0219c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a85b23-26e1-411e-900b-61928c28330c', 'volume_name': 'volume-82a85b23-26e1-411e-900b-61928c28330c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bad0811-13c8-4651-b355-319c5d961f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bad0811-13c8-4651-b355-319c5d961f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7feaae3f-9efd-44ab-aa9a-c0fde1563d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Volume 82a85b23-26e1-411e-900b-61928c28330c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a85b23-26e1-411e-900b-61928c28330c', 'volume_size': 1} Jul 03 23:58:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:58:38 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254" returned: 0 in 0.892s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:38 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1d2b86-86d2-400f-a8ca-00bfc7f66f36]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:58:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:38 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 Jul 03 23:58:38 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] Acquiring lock "cinder-fbadb966-748a-4830-89db-3d8de09af20f-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:58:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] Lock "cinder-fbadb966-748a-4830-89db-3d8de09af20f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:58:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] Acquiring lock "cinder-quobyte-fbadb966-748a-4830-89db-3d8de09af20f" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:58:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] Lock "cinder-quobyte-fbadb966-748a-4830-89db-3d8de09af20f" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:58:39 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b53786-3ba9-451f-8ac0-598822b80d43]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:58:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fbadb966-748a-4830-89db-3d8de09af20f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:39 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fbadb966-748a-4830-89db-3d8de09af20f Jul 03 23:58:39 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:39 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254" returned: 0 in 0.917s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 /opt/stack/data/cinder/conversion/b6276e00-46ee-4fe5-9483-7d1510813254.temp_image.f17448cf-ada2-40b5-9900-baab98696e1doftsr99a.img {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:39 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 /opt/stack/data/cinder/conversion/b6276e00-46ee-4fe5-9483-7d1510813254.temp_image.f17448cf-ada2-40b5-9900-baab98696e1doftsr99a.img Jul 03 23:58:39 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:40 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fbadb966-748a-4830-89db-3d8de09af20f" returned: 0 in 0.878s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fbadb966-748a-4830-89db-3d8de09af20f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:40 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fbadb966-748a-4830-89db-3d8de09af20f Jul 03 23:58:40 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:41 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-fbadb966-748a-4830-89db-3d8de09af20f" returned: 0 in 1.002s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] Lock "cinder-quobyte-fbadb966-748a-4830-89db-3d8de09af20f" released by "delete_volume" :: held 1.939s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:58:41 devstack cinder-volume[86676]: WARNING cinder.quota [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1641681240 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1641681240, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:58:41 devstack cinder-volume[86676]: WARNING cinder.quota [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1641681240 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1641681240, it is now deprecated. Please use the default quota class for default quota. Jul 03 23:58:41 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] Created reservations ['59205167-b0a0-4b35-a180-2c07d13e02b6', '751636c5-1590-4c7a-897f-d04b2a204cbf', '8f1e7eb4-1c89-44ee-a6d0-24ab832434d3', 'bc71572e-36ef-4219-850a-ea5eb4e1e454'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:58:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:58:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:58:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:58:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:58:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:58:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:41 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:58:41 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:42 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.043s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:42 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:58:42 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] Deleted volume successfully. Jul 03 23:58:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-acdb5636-a023-4e39-903c-64ae970a1991 tempest-VolumeTypesAccessTest-328112720 None] Lock "cinder-fbadb966-748a-4830-89db-3d8de09af20f-delete_volume" released by "delete_volume" :: held 3.439s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:58:45 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 /opt/stack/data/cinder/conversion/b6276e00-46ee-4fe5-9483-7d1510813254.temp_image.f17448cf-ada2-40b5-9900-baab98696e1doftsr99a.img" returned: 0 in 5.640s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:45 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb227deb-41aa-42b3-aca4-5a681d297660]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:58:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:45 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 Jul 03 23:58:45 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:46 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254" returned: 0 in 1.067s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:46 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/conversion/b6276e00-46ee-4fe5-9483-7d1510813254.temp_image.f17448cf-ada2-40b5-9900-baab98696e1doftsr99a.img {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 23:58:46 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] Converted 1024.00 MB image at 181.54 MB/s Jul 03 23:58:46 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] f17448cf-ada2-40b5-9900-baab98696e1d was raw, converting to qcow2 {{(pid=86676) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 03 23:58:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe5d6b5-e853-4bf2-9398-8c8f66958c94]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:58:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b6276e00-46ee-4fe5-9483-7d1510813254.temp_image.f17448cf-ada2-40b5-9900-baab98696e1doftsr99a.img {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:46 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b6276e00-46ee-4fe5-9483-7d1510813254.temp_image.f17448cf-ada2-40b5-9900-baab98696e1doftsr99a.img Jul 03 23:58:46 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:47 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b6276e00-46ee-4fe5-9483-7d1510813254.temp_image.f17448cf-ada2-40b5-9900-baab98696e1doftsr99a.img" returned: 0 in 1.090s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b6276e00-46ee-4fe5-9483-7d1510813254.temp_image.f17448cf-ada2-40b5-9900-baab98696e1doftsr99a.img {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:47 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b6276e00-46ee-4fe5-9483-7d1510813254.temp_image.f17448cf-ada2-40b5-9900-baab98696e1doftsr99a.img Jul 03 23:58:47 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:48 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b6276e00-46ee-4fe5-9483-7d1510813254.temp_image.f17448cf-ada2-40b5-9900-baab98696e1doftsr99a.img" returned: 1 in 0.960s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b6276e00-46ee-4fe5-9483-7d1510813254.temp_image.f17448cf-ada2-40b5-9900-baab98696e1doftsr99a.img' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 23:58:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b6276e00-46ee-4fe5-9483-7d1510813254.temp_image.f17448cf-ada2-40b5-9900-baab98696e1doftsr99a.img /opt/stack/data/cinder/conversion/vol_upload_wmagfwws {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:48 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b6276e00-46ee-4fe5-9483-7d1510813254.temp_image.f17448cf-ada2-40b5-9900-baab98696e1doftsr99a.img /opt/stack/data/cinder/conversion/vol_upload_wmagfwws Jul 03 23:58:48 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:49 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b6276e00-46ee-4fe5-9483-7d1510813254.temp_image.f17448cf-ada2-40b5-9900-baab98696e1doftsr99a.img /opt/stack/data/cinder/conversion/vol_upload_wmagfwws" returned: 0 in 0.735s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:49 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] Image conversion details: src /opt/stack/data/cinder/conversion/b6276e00-46ee-4fe5-9483-7d1510813254.temp_image.f17448cf-ada2-40b5-9900-baab98696e1doftsr99a.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_wmagfwws {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 23:58:49 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 03 23:58:49 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b44a83-799d-475e-ad11-6c4ea0487435]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:58:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wmagfwws {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:49 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wmagfwws Jul 03 23:58:49 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:50 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wmagfwws" returned: 0 in 0.809s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.807s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:58:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] Uploaded volume to glance image-id: f17448cf-ada2-40b5-9900-baab98696e1d. {{(pid=86676) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Jul 03 23:58:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.083s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:58:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:58:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-211731204',display_name='tempest-VolumesGetTest-Volume-1859080143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a85b23-26e1-411e-900b-61928c28330c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602cd61f822b4619b059d9e624ee4d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:38Z,use_quota=True,user_id='86b51b7ffd314859b8a1c337647a4889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:58:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Creating volume 82a85b23-26e1-411e-900b-61928c28330c {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:58:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:58:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:58:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:58:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:58:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:58:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:58:51 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:58:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82a85b23-26e1-411e-900b-61928c28330c 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:51 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82a85b23-26e1-411e-900b-61928c28330c 1073741824 Jul 03 23:58:51 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:51 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-84b764fb-c4ef-4f87-b29e-1da768e2b9f4 tempest-VolumesActionsTest-1510068861 None] Copy volume to image completed successfully. Jul 03 23:58:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] Acquiring lock "cinder-b6276e00-46ee-4fe5-9483-7d1510813254-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:58:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] Lock "cinder-b6276e00-46ee-4fe5-9483-7d1510813254-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:58:53 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82a85b23-26e1-411e-900b-61928c28330c 1073741824" returned: 0 in 1.353s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] Acquiring lock "cinder-quobyte-b6276e00-46ee-4fe5-9483-7d1510813254" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:58:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] Lock "cinder-quobyte-b6276e00-46ee-4fe5-9483-7d1510813254" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:58:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf768db-7238-4696-a8fb-824c419b5ca9]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:58:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82a85b23-26e1-411e-900b-61928c28330c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:53 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82a85b23-26e1-411e-900b-61928c28330c Jul 03 23:58:53 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:53 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 Jul 03 23:58:53 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:54 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82a85b23-26e1-411e-900b-61928c28330c" returned: 0 in 0.982s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] <== create_volume: return (2465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:58:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.468s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:58:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7feaae3f-9efd-44ab-aa9a-c0fde1563d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a85b23-26e1-411e-900b-61928c28330c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776ef400-e5eb-43b1-b83e-03564371184d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:54 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Volume volume-82a85b23-26e1-411e-900b-61928c28330c (82a85b23-26e1-411e-900b-61928c28330c): created successfully Jul 03 23:58:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776ef400-e5eb-43b1-b83e-03564371184d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Flow 'volume_create_manager' (4ae8d136-386d-450e-b8cd-7ff1076b4a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:58:54 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-368870ed-f194-47eb-9e1e-4e0fc47803d2 tempest-VolumesGetTest-1769109687 None] Created volume successfully. Jul 03 23:58:54 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254" returned: 0 in 1.195s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:54 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254 Jul 03 23:58:54 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] Acquiring lock "cinder-82a85b23-26e1-411e-900b-61928c28330c-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:58:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] Lock "cinder-82a85b23-26e1-411e-900b-61928c28330c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:58:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] Acquiring lock "cinder-quobyte-82a85b23-26e1-411e-900b-61928c28330c" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:58:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] Lock "cinder-quobyte-82a85b23-26e1-411e-900b-61928c28330c" acquired by "delete_volume" :: waited 0.059s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:58:54 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f518729b-f427-47ed-a54a-526279f979d0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:58:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82a85b23-26e1-411e-900b-61928c28330c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:55 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82a85b23-26e1-411e-900b-61928c28330c Jul 03 23:58:55 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:55 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b6276e00-46ee-4fe5-9483-7d1510813254" returned: 0 in 0.798s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] Lock "cinder-quobyte-b6276e00-46ee-4fe5-9483-7d1510813254" released by "delete_volume" :: held 2.074s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:58:55 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] Created reservations ['ac3255a5-516b-4360-bfe0-fde2b705e371', '5606d8f7-0550-48d2-9de6-f43ab1de8cdb', '0550662e-bad0-45c7-8a15-036ae11b7e65', '1386893a-d7cb-41e6-a687-0b7040513de3'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:58:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:58:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:58:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:58:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:58:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:58:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:55 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:58:55 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:56 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82a85b23-26e1-411e-900b-61928c28330c" returned: 0 in 1.222s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82a85b23-26e1-411e-900b-61928c28330c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:56 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82a85b23-26e1-411e-900b-61928c28330c Jul 03 23:58:56 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:56 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.148s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:56 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:58:56 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] Deleted volume successfully. Jul 03 23:58:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d026bee1-13ac-4aae-b233-e06a49b02d92 tempest-VolumesActionsTest-1510068861 None] Lock "cinder-b6276e00-46ee-4fe5-9483-7d1510813254-delete_volume" released by "delete_volume" :: held 3.652s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:58:57 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82a85b23-26e1-411e-900b-61928c28330c" returned: 0 in 1.127s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] Lock "cinder-quobyte-82a85b23-26e1-411e-900b-61928c28330c" released by "delete_volume" :: held 2.420s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:58:57 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] Created reservations ['3a65de88-a85f-4e5a-b2f0-48138b888744', '6c12a47e-2665-4858-99e5-9c9caf161167', 'aee3a614-1905-47a2-92dd-96d41c6af680', '8a9c9ae5-29cb-4e28-826d-7d0c43e64d3a'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:58:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:58:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:58:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:58:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:58:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:58:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:57 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:58:57 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] Acquiring lock "cinder-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:58:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] Lock "cinder-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:58:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] Acquiring lock "cinder-quobyte-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:58:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] Lock "cinder-quobyte-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b" acquired by "delete_volume" :: waited 0.035s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:58:58 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dffecc-6ad7-4dad-b436-0c9ccbd0261a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:58:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:58 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b Jul 03 23:58:58 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:58:58 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Jul 03 23:58:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.331s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:58:58 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:58:58 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] Deleted volume successfully. Jul 03 23:58:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e44cbd00-de2a-458a-a6b8-29ccefc18ef6 tempest-VolumesGetTest-1769109687 None] Lock "cinder-82a85b23-26e1-411e-900b-61928c28330c-delete_volume" released by "delete_volume" :: held 4.165s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Flow 'volume_create_manager' (83e96b8b-b05c-4247-b263-86d88a1428ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d8a497-3198-4114-9160-70a886554e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d8a497-3198-4114-9160-70a886554e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-493872734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf99bf9-50e7-42d2-81d7-df98c522ddee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65043d2d4a6b4cd69596cb0297c04d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:59Z,use_quota=True,user_id='6711a8a687ea4cd181a9afe92b42c159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a041fce-bbba-4fdd-a1d7-eaecd64d7148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a041fce-bbba-4fdd-a1d7-eaecd64d7148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55707af9-d610-4fca-a3f0-fd674d65c566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55707af9-d610-4fca-a3f0-fd674d65c566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bf99bf9-50e7-42d2-81d7-df98c522ddee', 'volume_name': 'volume-8bf99bf9-50e7-42d2-81d7-df98c522ddee', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de23c656-b639-4e62-8ee4-2d498171b649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de23c656-b639-4e62-8ee4-2d498171b649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acda52d-bbd1-45ad-8f51-d9e173407c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:58:59 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Volume 8bf99bf9-50e7-42d2-81d7-df98c522ddee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bf99bf9-50e7-42d2-81d7-df98c522ddee', 'volume_size': 1} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-493872734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf99bf9-50e7-42d2-81d7-df98c522ddee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65043d2d4a6b4cd69596cb0297c04d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:59Z,use_quota=True,user_id='6711a8a687ea4cd181a9afe92b42c159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Creating volume 8bf99bf9-50e7-42d2-81d7-df98c522ddee {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:58:59 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:58:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8bf99bf9-50e7-42d2-81d7-df98c522ddee 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:58:59 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8bf99bf9-50e7-42d2-81d7-df98c522ddee 1073741824 Jul 03 23:58:59 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:00 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b" returned: 0 in 1.496s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:00 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b Jul 03 23:59:00 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:01 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b" returned: 0 in 1.159s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] Lock "cinder-quobyte-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b" released by "delete_volume" :: held 2.761s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:01 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8bf99bf9-50e7-42d2-81d7-df98c522ddee 1073741824" returned: 0 in 1.606s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:01 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] Created reservations ['e10363a7-f3a7-4637-b883-6b87148eba18', '582a1f92-8e81-48d7-b22f-302bca622ff7', 'fac11fcf-16d7-4145-836c-9f827e76cd2f', '1a0632a7-0c96-4008-964a-d73ed54565af'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:59:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8bf99bf9-50e7-42d2-81d7-df98c522ddee {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:01 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8bf99bf9-50e7-42d2-81d7-df98c522ddee Jul 03 23:59:01 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:01 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:59:01 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:02 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8bf99bf9-50e7-42d2-81d7-df98c522ddee" returned: 0 in 1.381s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] <== create_volume: return (3095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:59:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.101s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acda52d-bbd1-45ad-8f51-d9e173407c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bf99bf9-50e7-42d2-81d7-df98c522ddee', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a28bc0e-84a2-4288-be14-296bb3ca1c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:02 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Volume volume-8bf99bf9-50e7-42d2-81d7-df98c522ddee (8bf99bf9-50e7-42d2-81d7-df98c522ddee): created successfully Jul 03 23:59:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a28bc0e-84a2-4288-be14-296bb3ca1c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Flow 'volume_create_manager' (83e96b8b-b05c-4247-b263-86d88a1428ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:59:02 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9110a2b0-d01e-4558-b9df-868bb41f9043 tempest-VolumesActionsTest-430972961 None] Created volume successfully. Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Flow 'volume_create_manager' (ba154982-5cba-46d3-ac26-d15501a6ad08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca0b231-388a-483e-b66c-859601929539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca0b231-388a-483e-b66c-859601929539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-772801706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e01c52f-b0fe-4ce9-8440-ad411025e3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602cd61f822b4619b059d9e624ee4d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:03Z,use_quota=True,user_id='86b51b7ffd314859b8a1c337647a4889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c71a7c-4a4f-4f24-bb7d-f58115b241d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c71a7c-4a4f-4f24-bb7d-f58115b241d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc114274-b9ed-41c9-9cdf-d01c3303939b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:03 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc114274-b9ed-41c9-9cdf-d01c3303939b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e01c52f-b0fe-4ce9-8440-ad411025e3fa', 'volume_name': 'volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b78ac5-7e77-440e-bbf8-83d9cd4e53be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b78ac5-7e77-440e-bbf8-83d9cd4e53be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a67c27-eb3a-4002-8af4-3b54d26b30d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:03 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Volume 8e01c52f-b0fe-4ce9-8440-ad411025e3fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa', 'volume_size': 1} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-772801706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e01c52f-b0fe-4ce9-8440-ad411025e3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602cd61f822b4619b059d9e624ee4d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:03Z,use_quota=True,user_id='86b51b7ffd314859b8a1c337647a4889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Creating volume 8e01c52f-b0fe-4ce9-8440-ad411025e3fa {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:59:03 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.878s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:59:03 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] Deleted volume successfully. Jul 03 23:59:03 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa 1073741824 Jul 03 23:59:03 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-78b65087-bfa5-4532-a326-4f88125c625b tempest-VolumesGetTest-1769109687 None] Lock "cinder-6e2fdf6a-7344-4385-8ab3-d655d50a5c7b-delete_volume" released by "delete_volume" :: held 5.175s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-11ef6bc6-1639-424d-9312-1cd375c273e9 tempest-VolumesActionsTest-430972961 None] Acquiring lock "cinder-8bf99bf9-50e7-42d2-81d7-df98c522ddee" by "attach_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-11ef6bc6-1639-424d-9312-1cd375c273e9 tempest-VolumesActionsTest-430972961 None] Lock "cinder-8bf99bf9-50e7-42d2-81d7-df98c522ddee" acquired by "attach_volume" :: waited 0.054s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-11ef6bc6-1639-424d-9312-1cd375c273e9 tempest-VolumesActionsTest-430972961 None] Attaching volume 8bf99bf9-50e7-42d2-81d7-df98c522ddee to instance 64e22629-9696-46b8-a055-b0ac0e52a650 at mountpoint /dev/vdb on host None. Jul 03 23:59:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-11ef6bc6-1639-424d-9312-1cd375c273e9 tempest-VolumesActionsTest-430972961 None] Attach volume completed successfully. Jul 03 23:59:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-11ef6bc6-1639-424d-9312-1cd375c273e9 tempest-VolumesActionsTest-430972961 None] Lock "cinder-8bf99bf9-50e7-42d2-81d7-df98c522ddee" released by "attach_volume" :: held 0.228s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:05 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa 1073741824" returned: 0 in 1.629s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:05 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa Jul 03 23:59:05 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:05 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0751994c-3b50-496e-ab43-bdf53c7feea8 tempest-VolumesActionsTest-1236879059 None] Terminate volume connection completed successfully. Jul 03 23:59:06 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa" returned: 0 in 0.957s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] <== create_volume: return (2673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:59:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.678s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a67c27-eb3a-4002-8af4-3b54d26b30d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0eeef4d-831b-44f2-95a1-afd135b20682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:06 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Volume volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa (8e01c52f-b0fe-4ce9-8440-ad411025e3fa): created successfully Jul 03 23:59:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0eeef4d-831b-44f2-95a1-afd135b20682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Flow 'volume_create_manager' (ba154982-5cba-46d3-ac26-d15501a6ad08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:59:06 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ac53dc45-6d48-401b-a7b5-979df4d770b1 tempest-VolumesGetTest-1769109687 None] Created volume successfully. Jul 03 23:59:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0751994c-3b50-496e-ab43-bdf53c7feea8 tempest-VolumesActionsTest-1236879059 None] Acquiring lock "cinder-8bf99bf9-50e7-42d2-81d7-df98c522ddee-detach_volume" by "detach_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0751994c-3b50-496e-ab43-bdf53c7feea8 tempest-VolumesActionsTest-1236879059 None] Lock "cinder-8bf99bf9-50e7-42d2-81d7-df98c522ddee-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:06 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0751994c-3b50-496e-ab43-bdf53c7feea8 tempest-VolumesActionsTest-1236879059 None] Detaching volume 8bf99bf9-50e7-42d2-81d7-df98c522ddee from instance 64e22629-9696-46b8-a055-b0ac0e52a650. Jul 03 23:59:06 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0751994c-3b50-496e-ab43-bdf53c7feea8 tempest-VolumesActionsTest-1236879059 None] Detach volume completed successfully. Jul 03 23:59:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0751994c-3b50-496e-ab43-bdf53c7feea8 tempest-VolumesActionsTest-1236879059 None] Lock "cinder-8bf99bf9-50e7-42d2-81d7-df98c522ddee-detach_volume" released by "detach_volume" :: held 0.159s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-06342967-bc05-4864-8493-652e3a9905e8 tempest-VolumesActionsTest-430972961 None] Acquiring lock "cinder-8bf99bf9-50e7-42d2-81d7-df98c522ddee-detach_volume" by "detach_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-06342967-bc05-4864-8493-652e3a9905e8 tempest-VolumesActionsTest-430972961 None] Lock "cinder-8bf99bf9-50e7-42d2-81d7-df98c522ddee-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:07 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-06342967-bc05-4864-8493-652e3a9905e8 tempest-VolumesActionsTest-430972961 None] Volume detach called, but volume not attached. Jul 03 23:59:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-06342967-bc05-4864-8493-652e3a9905e8 tempest-VolumesActionsTest-430972961 None] Lock "cinder-8bf99bf9-50e7-42d2-81d7-df98c522ddee-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:07 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:59:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Flow 'volume_create_manager' (4b6c1890-519a-42fb-9019-122f2b43af80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:59:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ebb417-dc0b-4b02-909d-222b2941a7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ebb417-dc0b-4b02-909d-222b2941a7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-533922154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a240767-e3bd-4df6-a63d-23984bcc1a1f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='602cd61f822b4619b059d9e624ee4d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=8e01c52f-b0fe-4ce9-8440-ad411025e3fa,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:07Z,use_quota=True,user_id='86b51b7ffd314859b8a1c337647a4889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55e19d6-0ebb-406f-8cd9-b306633eb306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55e19d6-0ebb-406f-8cd9-b306633eb306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a403d7-dafc-4f5d-8f2b-81ae132f9c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a403d7-dafc-4f5d-8f2b-81ae132f9c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4a240767-e3bd-4df6-a63d-23984bcc1a1f', 'volume_name': 'volume-4a240767-e3bd-4df6-a63d-23984bcc1a1f', 'volume_size': 1, 'source_volid': '8e01c52f-b0fe-4ce9-8440-ad411025e3fa', 'source_volstatus': 'available'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54822cd3-3234-464e-acb1-099cac6269ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54822cd3-3234-464e-acb1-099cac6269ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985ffc5a-f1fc-41a1-8c35-6e55829cfb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:07 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Volume 4a240767-e3bd-4df6-a63d-23984bcc1a1f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4a240767-e3bd-4df6-a63d-23984bcc1a1f', 'volume_size': 1, 'source_volid': '8e01c52f-b0fe-4ce9-8440-ad411025e3fa', 'source_volstatus': 'available'} Jul 03 23:59:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:07 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Cloning volume 8e01c52f-b0fe-4ce9-8440-ad411025e3fa to volume 4a240767-e3bd-4df6-a63d-23984bcc1a1f Jul 03 23:59:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Creating offline snapshot a0290d7f-b2d2-46c6-aff6-2b75923aff52 of volume 8e01c52f-b0fe-4ce9-8440-ad411025e3fa {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 23:59:07 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c10683-76cc-4158-8f9b-6c5df42cf167]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:07 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa Jul 03 23:59:07 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] Acquiring lock "cinder-8bf99bf9-50e7-42d2-81d7-df98c522ddee-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] Lock "cinder-8bf99bf9-50e7-42d2-81d7-df98c522ddee-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] Acquiring lock "cinder-quobyte-8bf99bf9-50e7-42d2-81d7-df98c522ddee" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] Lock "cinder-quobyte-8bf99bf9-50e7-42d2-81d7-df98c522ddee" acquired by "delete_volume" :: waited 0.034s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1f166a-7712-474f-92f1-ff774ddadc2d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8bf99bf9-50e7-42d2-81d7-df98c522ddee {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:08 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8bf99bf9-50e7-42d2-81d7-df98c522ddee Jul 03 23:59:08 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:08 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa" returned: 0 in 1.105s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Flow 'volume_create_manager' (16ee50a0-85ea-4aea-b981-18b91d8ad1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:59:08 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52 1G Jul 03 23:59:08 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7091fe-24da-4a05-ae63-89dae9ec6dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7091fe-24da-4a05-ae63-89dae9ec6dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1444949113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f5b863-bf26-4b38-9852-aa6dd0783c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='000c26a1d0534cb9b60485b22b0d7d6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:09Z,use_quota=True,user_id='db21cc98dff24e12aecddc978a733bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38153f9-10f7-4f72-845d-f01ee3682865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38153f9-10f7-4f72-845d-f01ee3682865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00942956-ad18-4bed-9d78-0ea17032fc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00942956-ad18-4bed-9d78-0ea17032fc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f5b863-bf26-4b38-9852-aa6dd0783c69', 'volume_name': 'volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4557568-3f7f-47b9-9e15-63aff899bc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4557568-3f7f-47b9-9e15-63aff899bc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f516f29-e8f8-4b86-bca6-92315e005a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:08 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Volume d8f5b863-bf26-4b38-9852-aa6dd0783c69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69', 'volume_size': 1} Jul 03 23:59:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:09 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8bf99bf9-50e7-42d2-81d7-df98c522ddee" returned: 0 in 0.928s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8bf99bf9-50e7-42d2-81d7-df98c522ddee {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:09 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8bf99bf9-50e7-42d2-81d7-df98c522ddee Jul 03 23:59:09 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:09 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:59:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Flow 'volume_create_manager' (3dd75920-7a54-41dc-b3b7-bc171c40238d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:59:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de880ad2-521d-4106-8a8c-876643059a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de880ad2-521d-4106-8a8c-876643059a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-62471670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f78e712-ef85-42c4-af38-d71af35e387d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68cbb6fc487145cabde2bd24e1b3439d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:10Z,use_quota=True,user_id='139ffe5bab094cde86d44c04f6c15d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89248d4-22c9-4c9d-aafc-826000f24999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89248d4-22c9-4c9d-aafc-826000f24999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f4536c-fdd0-49f0-bad2-4eeb9d75d6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f4536c-fdd0-49f0-bad2-4eeb9d75d6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f78e712-ef85-42c4-af38-d71af35e387d', 'volume_name': 'volume-4f78e712-ef85-42c4-af38-d71af35e387d', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ef63e8-5674-4ff1-9d2b-9204348443c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ef63e8-5674-4ff1-9d2b-9204348443c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e982e45c-b876-44d7-976d-de19bc59cfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:09 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Volume 4f78e712-ef85-42c4-af38-d71af35e387d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f78e712-ef85-42c4-af38-d71af35e387d', 'volume_size': 1} Jul 03 23:59:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:09 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52 1G" returned: 0 in 0.987s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:09 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52 Jul 03 23:59:09 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:10 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8bf99bf9-50e7-42d2-81d7-df98c522ddee" returned: 0 in 0.767s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] Lock "cinder-quobyte-8bf99bf9-50e7-42d2-81d7-df98c522ddee" released by "delete_volume" :: held 1.764s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:10 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] Created reservations ['069f8751-6c68-4db4-a0b6-c68d282ef9bb', '9a55b5e2-bff6-4aaa-9d77-ce4e062e7a34', '7a33d63e-65a6-49d7-af73-92f5f438f43f', '9c5a1e31-b023-407f-87c7-a807c12b97f8'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:59:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:10 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:59:10 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:10 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52" returned: 0 in 0.723s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:10 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52 is being set with open permissions: ugo+rw Jul 03 23:59:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:10 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52 Jul 03 23:59:10 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:10 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.710s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:10 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:59:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] Deleted volume successfully. Jul 03 23:59:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c7d79463-8ad6-4472-b9bc-6fd1eb42672c tempest-VolumesActionsTest-430972961 None] Lock "cinder-8bf99bf9-50e7-42d2-81d7-df98c522ddee-delete_volume" released by "delete_volume" :: held 2.830s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:11 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52" returned: 0 in 0.696s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:11 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.info Jul 03 23:59:11 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:11 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.info" returned: 0 in 0.668s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:11 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.info is being set with open permissions: ugo+rw Jul 03 23:59:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:11 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.info Jul 03 23:59:11 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:12 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.info" returned: 0 in 0.741s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Acquiring lock "cinder-quobyte-4a240767-e3bd-4df6-a63d-23984bcc1a1f" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Lock "cinder-quobyte-4a240767-e3bd-4df6-a63d-23984bcc1a1f" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] snapshot: a0290d7f-b2d2-46c6-aff6-2b75923aff52, volume: 4a240767-e3bd-4df6-a63d-23984bcc1a1f, {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 23:59:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:12 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4b251e-c05b-466f-91c4-56dd12b7a815]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:12 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52 Jul 03 23:59:12 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:13 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52" returned: 0 in 0.846s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:59:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 23:59:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 23:59:13 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73e5d4c-d376-4c8d-9b1d-6e61acd49a83]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:13 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa Jul 03 23:59:13 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:14 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa" returned: 0 in 0.785s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:14 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Path /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4a240767-e3bd-4df6-a63d-23984bcc1a1f not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 23:59:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4a240767-e3bd-4df6-a63d-23984bcc1a1f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:14 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4a240767-e3bd-4df6-a63d-23984bcc1a1f Jul 03 23:59:14 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:19 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4a240767-e3bd-4df6-a63d-23984bcc1a1f" returned: 0 in 4.872s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:19 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[76304ec7-3f00-43e7-b68e-d7c2d2eb0de2]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:19 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:59:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Flow 'volume_create_manager' (ff6e7b08-daf0-4d57-a559-3ea5d2043c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:59:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567e7f0e-00c0-4ff1-a364-27102acf3b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567e7f0e-00c0-4ff1-a364-27102acf3b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1174492144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd6da9f-5d9d-4623-ae73-fb481690346f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65043d2d4a6b4cd69596cb0297c04d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:19Z,use_quota=True,user_id='6711a8a687ea4cd181a9afe92b42c159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90041d56-f81b-48a3-961a-93a90c952baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:19 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa Jul 03 23:59:19 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90041d56-f81b-48a3-961a-93a90c952baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d613f6ae-b453-4032-9444-4ca492527c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d613f6ae-b453-4032-9444-4ca492527c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cd6da9f-5d9d-4623-ae73-fb481690346f', 'volume_name': 'volume-3cd6da9f-5d9d-4623-ae73-fb481690346f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44096ba4-562d-4c22-97d1-2834f93a12ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44096ba4-562d-4c22-97d1-2834f93a12ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6832342f-c52f-41f1-b804-7a980cb4a792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:19 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Volume 3cd6da9f-5d9d-4623-ae73-fb481690346f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cd6da9f-5d9d-4623-ae73-fb481690346f', 'volume_size': 1} Jul 03 23:59:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:20 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa" returned: 0 in 0.968s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:20 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa, size 1024.00 MB, duration 4.87 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4a240767-e3bd-4df6-a63d-23984bcc1a1f {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 23:59:20 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Converted 1024.00 MB image at 210.14 MB/s Jul 03 23:59:20 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4a240767-e3bd-4df6-a63d-23984bcc1a1f is being set with open permissions: ugo+rw Jul 03 23:59:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4a240767-e3bd-4df6-a63d-23984bcc1a1f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:20 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4a240767-e3bd-4df6-a63d-23984bcc1a1f Jul 03 23:59:20 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:20 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4a240767-e3bd-4df6-a63d-23984bcc1a1f" returned: 0 in 0.623s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Lock "cinder-quobyte-4a240767-e3bd-4df6-a63d-23984bcc1a1f" released by "_copy_volume_from_snapshot" :: held 8.193s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Acquiring lock "cinder-quobyte-a0290d7f-b2d2-46c6-aff6-2b75923aff52" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Lock "cinder-quobyte-a0290d7f-b2d2-46c6-aff6-2b75923aff52" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Deleting offline snapshot a0290d7f-b2d2-46c6-aff6-2b75923aff52 of volume 8e01c52f-b0fe-4ce9-8440-ad411025e3fa {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 23:59:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] snapshot_file for this snap is: volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 23:59:21 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f7f911-ab9c-4b8b-8e5f-a7935b9912fe]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:21 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52 Jul 03 23:59:21 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:21 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52" returned: 0 in 0.772s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:59:21 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a71b7b-83a8-4276-9dd3-6fddc95ad296]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:21 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa Jul 03 23:59:21 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:22 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa" returned: 0 in 0.755s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:22 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52 Jul 03 23:59:22 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:23 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52" returned: 0 in 0.746s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:23 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52 Jul 03 23:59:23 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:24 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa.a0290d7f-b2d2-46c6-aff6-2b75923aff52" returned: 0 in 0.705s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Lock "cinder-quobyte-a0290d7f-b2d2-46c6-aff6-2b75923aff52" released by "_delete_snapshot" :: held 3.078s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.399s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.104s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1444949113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f5b863-bf26-4b38-9852-aa6dd0783c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='000c26a1d0534cb9b60485b22b0d7d6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:09Z,use_quota=True,user_id='db21cc98dff24e12aecddc978a733bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:59:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Creating volume d8f5b863-bf26-4b38-9852-aa6dd0783c69 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:59:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:59:24 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:59:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:24 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 1073741824 Jul 03 23:59:24 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985ffc5a-f1fc-41a1-8c35-6e55829cfb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a240767-e3bd-4df6-a63d-23984bcc1a1f', 'volume_size': 1, 'source_volid': '8e01c52f-b0fe-4ce9-8440-ad411025e3fa', 'source_volstatus': 'available'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd2e18e-31cc-407b-9da7-3366e13ab264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:24 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Volume volume-4a240767-e3bd-4df6-a63d-23984bcc1a1f (4a240767-e3bd-4df6-a63d-23984bcc1a1f): created successfully Jul 03 23:59:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd2e18e-31cc-407b-9da7-3366e13ab264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Flow 'volume_create_manager' (4b6c1890-519a-42fb-9019-122f2b43af80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:59:24 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-23f03caf-c656-4afd-9577-e6f8cb50cc80 tempest-VolumesGetTest-1769109687 None] Created volume successfully. Jul 03 23:59:25 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 1073741824" returned: 0 in 0.921s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:25 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 Jul 03 23:59:25 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=67,cinder:SELECT=57,cinder:INSERT=19,cinder:DELETE=5 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Flow 'volume_create_manager' (284d3a13-7d14-4fe5-ac85-d5206cf9b946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a822ab5-f3b6-4db1-9142-d3bfa0cefa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a822ab5-f3b6-4db1-9142-d3bfa0cefa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:59:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2102543296',display_name='tempest-VolumesGetTest-Volume-486018748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5387661f-8c26-4f5f-8bdc-24fa474d5215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602cd61f822b4619b059d9e624ee4d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:26Z,use_quota=True,user_id='86b51b7ffd314859b8a1c337647a4889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2429e45-1af6-4b2c-83f5-abba4b14ad57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2429e45-1af6-4b2c-83f5-abba4b14ad57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6067ca-58c8-4142-9d35-eb7f5a5bc1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6067ca-58c8-4142-9d35-eb7f5a5bc1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5387661f-8c26-4f5f-8bdc-24fa474d5215', 'volume_name': 'volume-5387661f-8c26-4f5f-8bdc-24fa474d5215', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aaa7de2-5af2-4771-9466-2f0a65c892f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aaa7de2-5af2-4771-9466-2f0a65c892f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bec206d-b44a-487a-b4ce-5d1e370d818e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:25 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Volume 5387661f-8c26-4f5f-8bdc-24fa474d5215: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5387661f-8c26-4f5f-8bdc-24fa474d5215', 'volume_size': 1} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:25 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69" returned: 0 in 0.753s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.129s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-62471670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f78e712-ef85-42c4-af38-d71af35e387d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68cbb6fc487145cabde2bd24e1b3439d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:10Z,use_quota=True,user_id='139ffe5bab094cde86d44c04f6c15d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Creating volume 4f78e712-ef85-42c4-af38-d71af35e387d {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:59:25 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:25 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d 1073741824 Jul 03 23:59:25 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f516f29-e8f8-4b86-bca6-92315e005a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deee7ab1-298b-4b45-ab04-a139b69234c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:25 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Volume volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 (d8f5b863-bf26-4b38-9852-aa6dd0783c69): created successfully Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deee7ab1-298b-4b45-ab04-a139b69234c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Flow 'volume_create_manager' (16ee50a0-85ea-4aea-b981-18b91d8ad1df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:59:25 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c80e1a75-06f0-4d4e-9b9a-f053193a1ed9 tempest-VolumesCloneTest-188323227 None] Created volume successfully. Jul 03 23:59:26 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d 1073741824" returned: 0 in 0.859s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:26 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:59:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:26 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d Jul 03 23:59:26 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Flow 'volume_create_manager' (66ae1a1f-2bd0-4375-ac07-46757c87bd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:59:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29199949-d972-4f4a-92fc-9698187b0aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29199949-d972-4f4a-92fc-9698187b0aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1896517683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f630023f-d354-457c-9888-8be28949aa3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='000c26a1d0534cb9b60485b22b0d7d6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=d8f5b863-bf26-4b38-9852-aa6dd0783c69,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:27Z,use_quota=True,user_id='db21cc98dff24e12aecddc978a733bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820e132b-b47e-4ded-9fdd-288fe959b97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820e132b-b47e-4ded-9fdd-288fe959b97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a7e5aa-8075-4af5-a4c3-c46bc53c3c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a7e5aa-8075-4af5-a4c3-c46bc53c3c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f630023f-d354-457c-9888-8be28949aa3c', 'volume_name': 'volume-f630023f-d354-457c-9888-8be28949aa3c', 'volume_size': 2, 'source_volid': 'd8f5b863-bf26-4b38-9852-aa6dd0783c69', 'source_volstatus': 'available'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc5460a-0bdf-49ed-8ed7-a5b921e9f128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc5460a-0bdf-49ed-8ed7-a5b921e9f128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3773df3-31a9-4b2f-a6c4-ca829e46d068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:26 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Volume f630023f-d354-457c-9888-8be28949aa3c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f630023f-d354-457c-9888-8be28949aa3c', 'volume_size': 2, 'source_volid': 'd8f5b863-bf26-4b38-9852-aa6dd0783c69', 'source_volstatus': 'available'} Jul 03 23:59:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:27 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d" returned: 0 in 0.693s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:59:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.957s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1174492144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd6da9f-5d9d-4623-ae73-fb481690346f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65043d2d4a6b4cd69596cb0297c04d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:19Z,use_quota=True,user_id='6711a8a687ea4cd181a9afe92b42c159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Creating volume 3cd6da9f-5d9d-4623-ae73-fb481690346f {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:59:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:59:27 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:59:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3cd6da9f-5d9d-4623-ae73-fb481690346f 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e982e45c-b876-44d7-976d-de19bc59cfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f78e712-ef85-42c4-af38-d71af35e387d', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:27 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3cd6da9f-5d9d-4623-ae73-fb481690346f 1073741824 Jul 03 23:59:27 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9307a123-0b11-436e-b7fc-6b0186011d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:27 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Volume volume-4f78e712-ef85-42c4-af38-d71af35e387d (4f78e712-ef85-42c4-af38-d71af35e387d): created successfully Jul 03 23:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9307a123-0b11-436e-b7fc-6b0186011d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Flow 'volume_create_manager' (3dd75920-7a54-41dc-b3b7-bc171c40238d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:59:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-89244387-9e4a-4e89-b67f-d57cd2944467 tempest-SnapshotMetadataTestJSON-538704340 None] Created volume successfully. Jul 03 23:59:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dfabf5ce-7c92-4127-8d1a-9260eb009412 tempest-SnapshotMetadataTestJSON-538704340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:28 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3cd6da9f-5d9d-4623-ae73-fb481690346f 1073741824" returned: 0 in 0.908s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3cd6da9f-5d9d-4623-ae73-fb481690346f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:28 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3cd6da9f-5d9d-4623-ae73-fb481690346f Jul 03 23:59:28 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:29 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3cd6da9f-5d9d-4623-ae73-fb481690346f" returned: 0 in 0.658s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:59:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.305s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:59:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2102543296',display_name='tempest-VolumesGetTest-Volume-486018748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5387661f-8c26-4f5f-8bdc-24fa474d5215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602cd61f822b4619b059d9e624ee4d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:26Z,use_quota=True,user_id='86b51b7ffd314859b8a1c337647a4889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:59:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Creating volume 5387661f-8c26-4f5f-8bdc-24fa474d5215 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:59:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:59:29 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:59:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5387661f-8c26-4f5f-8bdc-24fa474d5215 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:29 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5387661f-8c26-4f5f-8bdc-24fa474d5215 1073741824 Jul 03 23:59:29 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6832342f-c52f-41f1-b804-7a980cb4a792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cd6da9f-5d9d-4623-ae73-fb481690346f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14107e0d-7e44-4d60-9cd0-b209b4fff328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:29 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Volume volume-3cd6da9f-5d9d-4623-ae73-fb481690346f (3cd6da9f-5d9d-4623-ae73-fb481690346f): created successfully Jul 03 23:59:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14107e0d-7e44-4d60-9cd0-b209b4fff328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Flow 'volume_create_manager' (ff6e7b08-daf0-4d57-a559-3ea5d2043c7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:59:29 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1415d570-eb80-46b2-a0f3-acab3fce9c5b tempest-VolumesActionsTest-430972961 None] Created volume successfully. Jul 03 23:59:29 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5387661f-8c26-4f5f-8bdc-24fa474d5215 1073741824" returned: 0 in 0.856s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5387661f-8c26-4f5f-8bdc-24fa474d5215 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:29 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5387661f-8c26-4f5f-8bdc-24fa474d5215 Jul 03 23:59:29 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] Acquiring lock "cinder-3cd6da9f-5d9d-4623-ae73-fb481690346f-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] Lock "cinder-3cd6da9f-5d9d-4623-ae73-fb481690346f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] Acquiring lock "cinder-quobyte-3cd6da9f-5d9d-4623-ae73-fb481690346f" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] Lock "cinder-quobyte-3cd6da9f-5d9d-4623-ae73-fb481690346f" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:30 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15d5c7e-9c89-43a2-91d4-e4704a03e87f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3cd6da9f-5d9d-4623-ae73-fb481690346f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:30 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3cd6da9f-5d9d-4623-ae73-fb481690346f Jul 03 23:59:30 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:30 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5387661f-8c26-4f5f-8bdc-24fa474d5215" returned: 0 in 0.656s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:59:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.739s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:30 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Cloning volume d8f5b863-bf26-4b38-9852-aa6dd0783c69 to volume f630023f-d354-457c-9888-8be28949aa3c Jul 03 23:59:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bec206d-b44a-487a-b4ce-5d1e370d818e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5387661f-8c26-4f5f-8bdc-24fa474d5215', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95a4f63-0d95-4426-b9e1-7c573af1eee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:30 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Volume volume-5387661f-8c26-4f5f-8bdc-24fa474d5215 (5387661f-8c26-4f5f-8bdc-24fa474d5215): created successfully Jul 03 23:59:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95a4f63-0d95-4426-b9e1-7c573af1eee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Flow 'volume_create_manager' (284d3a13-7d14-4fe5-ac85-d5206cf9b946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:59:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Creating offline snapshot 4c8caee0-1148-4f5f-922c-d3ce48999642 of volume d8f5b863-bf26-4b38-9852-aa6dd0783c69 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 23:59:30 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c6278bae-f2ce-4f45-95c0-d7d0834410c0 tempest-VolumesGetTest-1769109687 None] Created volume successfully. Jul 03 23:59:30 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d7c9ce-e868-4d53-99d5-8f1871787bd9]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:30 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 Jul 03 23:59:30 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:31 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] Acquiring lock "cinder-5387661f-8c26-4f5f-8bdc-24fa474d5215-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3cd6da9f-5d9d-4623-ae73-fb481690346f" returned: 0 in 0.847s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3cd6da9f-5d9d-4623-ae73-fb481690346f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] Lock "cinder-5387661f-8c26-4f5f-8bdc-24fa474d5215-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:31 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3cd6da9f-5d9d-4623-ae73-fb481690346f Jul 03 23:59:31 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] Acquiring lock "cinder-quobyte-5387661f-8c26-4f5f-8bdc-24fa474d5215" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] Lock "cinder-quobyte-5387661f-8c26-4f5f-8bdc-24fa474d5215" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:31 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[03541004-9000-4402-96e3-f64997ee682a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5387661f-8c26-4f5f-8bdc-24fa474d5215 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:31 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5387661f-8c26-4f5f-8bdc-24fa474d5215 Jul 03 23:59:31 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:31 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69" returned: 0 in 0.925s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:31 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642 1G Jul 03 23:59:31 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:31 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3cd6da9f-5d9d-4623-ae73-fb481690346f" returned: 0 in 0.788s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] Lock "cinder-quobyte-3cd6da9f-5d9d-4623-ae73-fb481690346f" released by "delete_volume" :: held 1.688s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:31 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] Created reservations ['02c15949-8ba8-44e6-828f-64b09f6b2038', '0e15ca12-de40-4368-8190-ab3be26a769e', 'b883e383-e083-45c7-96b2-caddb5ee2d38', '59e1a418-8ff0-4afe-92f9-073d2a4f507a'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:59:31 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=63,cinder:UPDATE=73,cinder:DELETE=9,cinder:INSERT=14 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 23:59:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:32 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:59:32 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:32 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5387661f-8c26-4f5f-8bdc-24fa474d5215" returned: 0 in 0.922s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5387661f-8c26-4f5f-8bdc-24fa474d5215 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:32 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5387661f-8c26-4f5f-8bdc-24fa474d5215 Jul 03 23:59:32 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:32 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642 1G" returned: 0 in 0.963s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:32 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642 Jul 03 23:59:32 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:32 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.731s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:32 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:59:32 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] Deleted volume successfully. Jul 03 23:59:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3596de1e-868a-471a-80ff-d04993f68eb8 tempest-VolumesActionsTest-1236879059 None] Lock "cinder-3cd6da9f-5d9d-4623-ae73-fb481690346f-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:32 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5387661f-8c26-4f5f-8bdc-24fa474d5215" returned: 0 in 0.809s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] Lock "cinder-quobyte-5387661f-8c26-4f5f-8bdc-24fa474d5215" released by "delete_volume" :: held 1.794s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] Created reservations ['e2c975bf-a1ab-41eb-ad56-6c9d89a57c18', '9bfb6cc0-995f-49c3-908e-6a817ab61657', '201eac51-b7c8-44c2-84e5-6fbc2813bc2f', '247eb311-0555-4e92-8395-34c691516c93'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:33 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:59:33 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Flow 'volume_create_manager' (e70be5b2-9e93-4861-a12a-c73dbcc273c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f537b6fe-dfa8-4664-8eac-76e7596d436d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f537b6fe-dfa8-4664-8eac-76e7596d436d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1181390668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbdc373a-e80b-4e97-ad57-037f28767fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65043d2d4a6b4cd69596cb0297c04d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:33Z,use_quota=True,user_id='6711a8a687ea4cd181a9afe92b42c159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2750b968-bc8c-44cd-b42d-f9d3041da7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2750b968-bc8c-44cd-b42d-f9d3041da7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312bd086-1340-4bc9-9e6d-7a7cdbcfb891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312bd086-1340-4bc9-9e6d-7a7cdbcfb891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbdc373a-e80b-4e97-ad57-037f28767fd1', 'volume_name': 'volume-dbdc373a-e80b-4e97-ad57-037f28767fd1', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af01754c-0b39-465d-97c3-9912a7a0d06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af01754c-0b39-465d-97c3-9912a7a0d06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74536cf9-2c68-4ad4-8a72-c2732bd9cf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:33 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Volume dbdc373a-e80b-4e97-ad57-037f28767fd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbdc373a-e80b-4e97-ad57-037f28767fd1', 'volume_size': 1} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] Acquiring lock "cinder-4a240767-e3bd-4df6-a63d-23984bcc1a1f-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:33 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:59:33 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] Lock "cinder-4a240767-e3bd-4df6-a63d-23984bcc1a1f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:33 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642" returned: 0 in 0.916s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:33 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642 is being set with open permissions: ugo+rw Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] Acquiring lock "cinder-quobyte-4a240767-e3bd-4df6-a63d-23984bcc1a1f" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:33 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642 Jul 03 23:59:33 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] Lock "cinder-quobyte-4a240767-e3bd-4df6-a63d-23984bcc1a1f" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7196f463-c4b2-46d0-9761-87d19c1a00d7]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4a240767-e3bd-4df6-a63d-23984bcc1a1f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:33 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4a240767-e3bd-4df6-a63d-23984bcc1a1f Jul 03 23:59:33 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:33 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.782s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:59:33 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] Deleted volume successfully. Jul 03 23:59:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-262548d6-2827-4c54-8b57-843c2483e578 tempest-VolumesGetTest-1769109687 None] Lock "cinder-5387661f-8c26-4f5f-8bdc-24fa474d5215-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:34 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.783s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:59:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 23:59:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 23:59:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 03 23:59:34 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642" returned: 0 in 0.809s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:34 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.info Jul 03 23:59:34 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:34 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4a240767-e3bd-4df6-a63d-23984bcc1a1f" returned: 0 in 0.942s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4a240767-e3bd-4df6-a63d-23984bcc1a1f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:34 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4a240767-e3bd-4df6-a63d-23984bcc1a1f Jul 03 23:59:34 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:35 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.info" returned: 0 in 0.668s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:35 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.info is being set with open permissions: ugo+rw Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:35 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.info Jul 03 23:59:35 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:35 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4a240767-e3bd-4df6-a63d-23984bcc1a1f" returned: 0 in 0.670s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] Lock "cinder-quobyte-4a240767-e3bd-4df6-a63d-23984bcc1a1f" released by "delete_volume" :: held 1.681s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] Created reservations ['af6b66b7-d504-4705-bcba-8a7f03ed2ed1', '461dcde3-7dac-44f9-9f5b-b5cbf0cf6cfd', 'fae48378-8ef6-4ff7-95c4-7c2cf71ae8cb', '962ae8a1-b1d6-497f-bc52-707b52f31dab'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:35 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:59:35 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] Acquiring lock "cinder-8e01c52f-b0fe-4ce9-8440-ad411025e3fa-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] Lock "cinder-8e01c52f-b0fe-4ce9-8440-ad411025e3fa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:35 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.info" returned: 0 in 0.732s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Acquiring lock "cinder-quobyte-f630023f-d354-457c-9888-8be28949aa3c" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Lock "cinder-quobyte-f630023f-d354-457c-9888-8be28949aa3c" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] snapshot: 4c8caee0-1148-4f5f-922c-d3ce48999642, volume: f630023f-d354-457c-9888-8be28949aa3c, {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] Acquiring lock "cinder-quobyte-8e01c52f-b0fe-4ce9-8440-ad411025e3fa" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] Lock "cinder-quobyte-8e01c52f-b0fe-4ce9-8440-ad411025e3fa" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[868ec9e2-053b-4eaf-89e3-7be9109acafe]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f699ed5f-ada1-44e1-82dd-aed0147e8fb3]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:36 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642 Jul 03 23:59:36 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:36 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa Jul 03 23:59:36 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:36 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.715s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:36 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:59:36 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] Deleted volume successfully. Jul 03 23:59:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed81738b-7bc1-4728-a015-440a79d582b5 tempest-VolumesGetTest-1769109687 None] Lock "cinder-4a240767-e3bd-4df6-a63d-23984bcc1a1f-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:36 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642" returned: 0 in 0.822s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:59:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 23:59:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 23:59:36 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec7bb62-9e1c-4d85-8f4f-cd5286d3ffb8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:36 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa" returned: 0 in 0.837s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:36 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa Jul 03 23:59:36 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:36 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 Jul 03 23:59:36 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:37 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8e01c52f-b0fe-4ce9-8440-ad411025e3fa" returned: 0 in 0.656s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] Lock "cinder-quobyte-8e01c52f-b0fe-4ce9-8440-ad411025e3fa" released by "delete_volume" :: held 1.560s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:37 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] Created reservations ['25b63719-56f2-4667-839e-b83ab1124f8b', '16a70d3a-6500-4f2f-9c7a-67bb22d371d3', '55aea676-6c9f-4e11-b64f-68c095cc153f', '9f35b130-a1be-451d-8f28-9ce8e1a2dc2b'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:59:37 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69" returned: 0 in 0.798s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:37 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Path /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f630023f-d354-457c-9888-8be28949aa3c not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 23:59:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f630023f-d354-457c-9888-8be28949aa3c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:37 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f630023f-d354-457c-9888-8be28949aa3c Jul 03 23:59:37 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:37 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:59:37 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:38 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.693s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:38 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:59:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] Deleted volume successfully. Jul 03 23:59:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a63c71eb-8212-4780-a950-9e0f09748d43 tempest-VolumesGetTest-1769109687 None] Lock "cinder-8e01c52f-b0fe-4ce9-8440-ad411025e3fa-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:38 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:59:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Flow 'volume_create_manager' (cd4e4920-9ea0-4d0b-bdc2-043a06e7d14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:59:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44daf1ae-4d44-4d41-9df7-d42afe1b35b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44daf1ae-4d44-4d41-9df7-d42afe1b35b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2123073454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45757270-bb9f-4278-bd0b-dd4e151598e9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='602cd61f822b4619b059d9e624ee4d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:39Z,use_quota=True,user_id='86b51b7ffd314859b8a1c337647a4889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dec63db-b98f-46d8-b6ad-7c7d35d9865b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dec63db-b98f-46d8-b6ad-7c7d35d9865b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782a2644-9f70-4db8-8367-7fb4640f18fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:39 devstack cinder-volume[86676]: DEBUG cinder.image.glance [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Creating Keystone auth plugin from conf {{(pid=86676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 23:59:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782a2644-9f70-4db8-8367-7fb4640f18fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45757270-bb9f-4278-bd0b-dd4e151598e9', 'volume_name': 'volume-45757270-bb9f-4278-bd0b-dd4e151598e9', 'volume_size': 1, 'image_id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47a94a0f3bea4708b842e25ca5b22b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d1ad21-2237-499d-8917-200dae6fa80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d1ad21-2237-499d-8917-200dae6fa80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a79555-a40e-4832-8de4-8bf333e79327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:39 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Volume 45757270-bb9f-4278-bd0b-dd4e151598e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45757270-bb9f-4278-bd0b-dd4e151598e9', 'volume_size': 1, 'image_id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47a94a0f3bea4708b842e25ca5b22b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 23:59:39 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Trying to clone 45757270-bb9f-4278-bd0b-dd4e151598e9 from image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}]). {{(pid=86676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 23:59:40 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_jd8aslg0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 23:59:40 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Image download 20.69 MB at 20.69 MB/s Jul 03 23:59:40 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5c77d4-7114-4559-a987-2f7c1dc6830e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_jd8aslg0devstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:41 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_jd8aslg0devstack@QuobyteHD Jul 03 23:59:41 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:42 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_jd8aslg0devstack@QuobyteHD" returned: 0 in 1.445s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:42 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Temporary image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 is fetched for user 86b51b7ffd314859b8a1c337647a4889. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 23:59:42 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf623e9-971d-44fc-b57d-75226e291b0c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_jd8aslg0devstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:42 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_jd8aslg0devstack@QuobyteHD Jul 03 23:59:42 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:42 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f630023f-d354-457c-9888-8be28949aa3c" returned: 0 in 5.137s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:42 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a8d392-bd3e-4741-ac36-9e02872e478f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:42 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 Jul 03 23:59:42 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:43 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_jd8aslg0devstack@QuobyteHD" returned: 0 in 0.834s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:43 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69" returned: 0 in 0.910s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:43 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69, size 1024.00 MB, duration 5.14 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f630023f-d354-457c-9888-8be28949aa3c {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 23:59:43 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Converted 1024.00 MB image at 199.30 MB/s Jul 03 23:59:43 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f630023f-d354-457c-9888-8be28949aa3c is being set with open permissions: ugo+rw Jul 03 23:59:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f630023f-d354-457c-9888-8be28949aa3c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:43 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f630023f-d354-457c-9888-8be28949aa3c Jul 03 23:59:43 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:44 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f630023f-d354-457c-9888-8be28949aa3c" returned: 0 in 0.639s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Lock "cinder-quobyte-f630023f-d354-457c-9888-8be28949aa3c" released by "_copy_volume_from_snapshot" :: held 8.434s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Acquiring lock "cinder-quobyte-4c8caee0-1148-4f5f-922c-d3ce48999642" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Lock "cinder-quobyte-4c8caee0-1148-4f5f-922c-d3ce48999642" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Deleting offline snapshot 4c8caee0-1148-4f5f-922c-d3ce48999642 of volume d8f5b863-bf26-4b38-9852-aa6dd0783c69 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 23:59:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] snapshot_file for this snap is: volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 23:59:44 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcfbfdc-41de-4883-b5f0-9dd60675545f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:44 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642 Jul 03 23:59:44 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:45 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642" returned: 0 in 0.767s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:59:45 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaacb08-78dd-468f-96c7-870aeacda4fa]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:45 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 Jul 03 23:59:45 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:45 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69" returned: 0 in 0.736s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:45 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642 Jul 03 23:59:45 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:46 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642" returned: 0 in 0.751s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:46 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642 Jul 03 23:59:46 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:47 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69.4c8caee0-1148-4f5f-922c-d3ce48999642" returned: 0 in 0.687s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Lock "cinder-quobyte-4c8caee0-1148-4f5f-922c-d3ce48999642" released by "_delete_snapshot" :: held 3.033s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.760s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dfabf5ce-7c92-4127-8d1a-9260eb009412 tempest-SnapshotMetadataTestJSON-538704340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 19.079s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-dfabf5ce-7c92-4127-8d1a-9260eb009412 tempest-SnapshotMetadataTestJSON-538704340 None] Creating offline snapshot 4c60e30e-54fa-4ff3-a45a-777b4c03b66c of volume 4f78e712-ef85-42c4-af38-d71af35e387d {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 23:59:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3773df3-31a9-4b2f-a6c4-ca829e46d068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f630023f-d354-457c-9888-8be28949aa3c', 'volume_size': 2, 'source_volid': 'd8f5b863-bf26-4b38-9852-aa6dd0783c69', 'source_volstatus': 'available'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7114f75e-78ee-49de-9a78-c7a53ac16ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:47 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[742aa229-797a-4773-8d61-f500b98b0ca8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dfabf5ce-7c92-4127-8d1a-9260eb009412 tempest-SnapshotMetadataTestJSON-538704340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:47 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Volume volume-f630023f-d354-457c-9888-8be28949aa3c (f630023f-d354-457c-9888-8be28949aa3c): created successfully Jul 03 23:59:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7114f75e-78ee-49de-9a78-c7a53ac16ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Flow 'volume_create_manager' (66ae1a1f-2bd0-4375-ac07-46757c87bd16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:59:47 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-407f3604-8034-4d45-9ddc-4b45d8a26f98 tempest-VolumesCloneTest-188323227 None] Created volume successfully. Jul 03 23:59:47 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d Jul 03 23:59:47 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:48 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dfabf5ce-7c92-4127-8d1a-9260eb009412 tempest-SnapshotMetadataTestJSON-538704340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d" returned: 0 in 0.794s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dfabf5ce-7c92-4127-8d1a-9260eb009412 tempest-SnapshotMetadataTestJSON-538704340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:48 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c 1G Jul 03 23:59:48 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] Acquiring lock "cinder-f630023f-d354-457c-9888-8be28949aa3c-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] Lock "cinder-f630023f-d354-457c-9888-8be28949aa3c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] Acquiring lock "cinder-quobyte-f630023f-d354-457c-9888-8be28949aa3c" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] Lock "cinder-quobyte-f630023f-d354-457c-9888-8be28949aa3c" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:48 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffb054a-d4ef-4175-89b5-872c3d1e6f3b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f630023f-d354-457c-9888-8be28949aa3c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:48 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f630023f-d354-457c-9888-8be28949aa3c Jul 03 23:59:48 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:49 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dfabf5ce-7c92-4127-8d1a-9260eb009412 tempest-SnapshotMetadataTestJSON-538704340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c 1G" returned: 0 in 0.856s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dfabf5ce-7c92-4127-8d1a-9260eb009412 tempest-SnapshotMetadataTestJSON-538704340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f78e712-ef85-42c4-af38-d71af35e387d -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:49 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f78e712-ef85-42c4-af38-d71af35e387d -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c Jul 03 23:59:49 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:49 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f630023f-d354-457c-9888-8be28949aa3c" returned: 0 in 0.839s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f630023f-d354-457c-9888-8be28949aa3c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:49 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f630023f-d354-457c-9888-8be28949aa3c Jul 03 23:59:49 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:49 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dfabf5ce-7c92-4127-8d1a-9260eb009412 tempest-SnapshotMetadataTestJSON-538704340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f78e712-ef85-42c4-af38-d71af35e387d -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c" returned: 0 in 0.730s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:49 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-dfabf5ce-7c92-4127-8d1a-9260eb009412 tempest-SnapshotMetadataTestJSON-538704340 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c is being set with open permissions: ugo+rw Jul 03 23:59:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dfabf5ce-7c92-4127-8d1a-9260eb009412 tempest-SnapshotMetadataTestJSON-538704340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:49 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c Jul 03 23:59:49 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:50 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f630023f-d354-457c-9888-8be28949aa3c" returned: 0 in 0.680s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] Lock "cinder-quobyte-f630023f-d354-457c-9888-8be28949aa3c" released by "delete_volume" :: held 1.574s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] Created reservations ['8c0aa840-6754-4553-a76e-9a6337dc7698', '4bee308e-3413-49d6-93f0-09893e1bff7f', '353fa280-2426-472a-88bc-e8b86664c3b9', '76e06834-87a4-4cd4-896b-f9745776810b'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:50 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:59:50 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:50 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dfabf5ce-7c92-4127-8d1a-9260eb009412 tempest-SnapshotMetadataTestJSON-538704340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c" returned: 0 in 0.676s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dfabf5ce-7c92-4127-8d1a-9260eb009412 tempest-SnapshotMetadataTestJSON-538704340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:50 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.info Jul 03 23:59:50 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] Acquiring lock "cinder-d8f5b863-bf26-4b38-9852-aa6dd0783c69-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] Lock "cinder-d8f5b863-bf26-4b38-9852-aa6dd0783c69-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] Acquiring lock "cinder-quobyte-d8f5b863-bf26-4b38-9852-aa6dd0783c69" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] Lock "cinder-quobyte-d8f5b863-bf26-4b38-9852-aa6dd0783c69" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1542892b-3857-4fb1-a02c-3b381f638b6a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:50 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.732s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:59:50 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] Deleted volume successfully. Jul 03 23:59:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0f621d6c-e81a-49e7-9253-ac0829e32bca tempest-VolumesCloneTest-188323227 None] Lock "cinder-f630023f-d354-457c-9888-8be28949aa3c-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:51 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 Jul 03 23:59:51 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:51 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dfabf5ce-7c92-4127-8d1a-9260eb009412 tempest-SnapshotMetadataTestJSON-538704340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.info" returned: 0 in 0.763s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:51 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-dfabf5ce-7c92-4127-8d1a-9260eb009412 tempest-SnapshotMetadataTestJSON-538704340 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.info is being set with open permissions: ugo+rw Jul 03 23:59:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dfabf5ce-7c92-4127-8d1a-9260eb009412 tempest-SnapshotMetadataTestJSON-538704340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:51 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.info Jul 03 23:59:51 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:51 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69" returned: 0 in 0.784s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:51 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69 Jul 03 23:59:51 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:51 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dfabf5ce-7c92-4127-8d1a-9260eb009412 tempest-SnapshotMetadataTestJSON-538704340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.info" returned: 0 in 0.693s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dfabf5ce-7c92-4127-8d1a-9260eb009412 tempest-SnapshotMetadataTestJSON-538704340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.606s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.688s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1181390668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbdc373a-e80b-4e97-ad57-037f28767fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65043d2d4a6b4cd69596cb0297c04d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:33Z,use_quota=True,user_id='6711a8a687ea4cd181a9afe92b42c159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:59:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Creating volume dbdc373a-e80b-4e97-ad57-037f28767fd1 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:59:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:59:51 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:59:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-dbdc373a-e80b-4e97-ad57-037f28767fd1 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:52 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-dbdc373a-e80b-4e97-ad57-037f28767fd1 1073741824 Jul 03 23:59:52 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:52 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-dfabf5ce-7c92-4127-8d1a-9260eb009412 tempest-SnapshotMetadataTestJSON-538704340 None] Create snapshot completed successfully Jul 03 23:59:52 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d8f5b863-bf26-4b38-9852-aa6dd0783c69" returned: 0 in 0.744s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] Lock "cinder-quobyte-d8f5b863-bf26-4b38-9852-aa6dd0783c69" released by "delete_volume" :: held 1.594s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:52 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] Created reservations ['b16aba9f-69f4-4b7d-9789-104432a358d4', '5b42a618-f232-448f-90ce-2e05e8ef24f2', '40bd6c05-9287-4ab2-b7da-624cd8fb875b', 'b2888266-10cd-440f-90e2-65dbedcdae30'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:59:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:52 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:59:52 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:53 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-dbdc373a-e80b-4e97-ad57-037f28767fd1 1073741824" returned: 0 in 1.037s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-dbdc373a-e80b-4e97-ad57-037f28767fd1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:53 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-dbdc373a-e80b-4e97-ad57-037f28767fd1 Jul 03 23:59:53 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] Acquiring lock "cinder-4c60e30e-54fa-4ff3-a45a-777b4c03b66c-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] Lock "cinder-4c60e30e-54fa-4ff3-a45a-777b4c03b66c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] Acquiring lock "cinder-quobyte-4f78e712-ef85-42c4-af38-d71af35e387d" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] Lock "cinder-quobyte-4f78e712-ef85-42c4-af38-d71af35e387d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] Acquiring lock "cinder-quobyte-4c60e30e-54fa-4ff3-a45a-777b4c03b66c" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] Lock "cinder-quobyte-4c60e30e-54fa-4ff3-a45a-777b4c03b66c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] Deleting offline snapshot 4c60e30e-54fa-4ff3-a45a-777b4c03b66c of volume 4f78e712-ef85-42c4-af38-d71af35e387d {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 23:59:53 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] snapshot_file for this snap is: volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.783s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:59:53 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] Deleted volume successfully. Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c081e703-b005-499a-a62e-264a2c19c338]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2e136104-9c60-4276-a0c6-4a1febed0785 tempest-VolumesCloneTest-188323227 None] Lock "cinder-d8f5b863-bf26-4b38-9852-aa6dd0783c69-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:53 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c Jul 03 23:59:53 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:53 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-dbdc373a-e80b-4e97-ad57-037f28767fd1" returned: 0 in 0.806s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.753s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2123073454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45757270-bb9f-4278-bd0b-dd4e151598e9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='602cd61f822b4619b059d9e624ee4d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:39Z,use_quota=True,user_id='86b51b7ffd314859b8a1c337647a4889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Creating volume 45757270-bb9f-4278-bd0b-dd4e151598e9 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:59:53 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:53 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 1073741824 Jul 03 23:59:53 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74536cf9-2c68-4ad4-8a72-c2732bd9cf9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbdc373a-e80b-4e97-ad57-037f28767fd1', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596b625b-36a6-4434-99c2-20f27d7e260a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:54 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Volume volume-dbdc373a-e80b-4e97-ad57-037f28767fd1 (dbdc373a-e80b-4e97-ad57-037f28767fd1): created successfully Jul 03 23:59:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596b625b-36a6-4434-99c2-20f27d7e260a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Flow 'volume_create_manager' (e70be5b2-9e93-4861-a12a-c73dbcc273c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:59:54 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6203cad3-f7ed-4b4f-aca8-bc61617dfdb7 tempest-VolumesActionsTest-430972961 None] Created volume successfully. Jul 03 23:59:54 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c" returned: 0 in 0.894s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f78e712-ef85-42c4-af38-d71af35e387d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 23:59:54 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8301b160-8340-4bc4-851b-22e02b2e4115]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:54 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d Jul 03 23:59:54 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] Acquiring lock "cinder-dbdc373a-e80b-4e97-ad57-037f28767fd1-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] Lock "cinder-dbdc373a-e80b-4e97-ad57-037f28767fd1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:55 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 1073741824" returned: 0 in 1.162s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] Acquiring lock "cinder-quobyte-dbdc373a-e80b-4e97-ad57-037f28767fd1" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] Lock "cinder-quobyte-dbdc373a-e80b-4e97-ad57-037f28767fd1" acquired by "delete_volume" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:55 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c32ef62-7205-44fb-9fd1-0f6a3e70dff6]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-dbdc373a-e80b-4e97-ad57-037f28767fd1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:55 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 Jul 03 23:59:55 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:55 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-dbdc373a-e80b-4e97-ad57-037f28767fd1 Jul 03 23:59:55 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:55 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d" returned: 0 in 1.078s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:55 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c Jul 03 23:59:55 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:55 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9" returned: 0 in 0.760s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 23:59:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:55 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Attempting download of 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 ((None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}])) to volume 45757270-bb9f-4278-bd0b-dd4e151598e9. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 23:59:56 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e3518f-8b7d-48a0-be0b-7135111d4e77]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_vcc8ye3h {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:56 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-dbdc373a-e80b-4e97-ad57-037f28767fd1" returned: 0 in 0.986s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-dbdc373a-e80b-4e97-ad57-037f28767fd1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:56 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_vcc8ye3h Jul 03 23:59:56 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:56 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-dbdc373a-e80b-4e97-ad57-037f28767fd1 Jul 03 23:59:56 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:56 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c" returned: 0 in 0.907s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:56 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c Jul 03 23:59:56 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:57 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_vcc8ye3h" returned: 0 in 1.012s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_vcc8ye3h {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:57 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-dbdc373a-e80b-4e97-ad57-037f28767fd1" returned: 0 in 0.971s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] Lock "cinder-quobyte-dbdc373a-e80b-4e97-ad57-037f28767fd1" released by "delete_volume" :: held 2.029s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:57 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_vcc8ye3h Jul 03 23:59:57 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:57 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d.4c60e30e-54fa-4ff3-a45a-777b4c03b66c" returned: 0 in 0.939s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:57 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] Created reservations ['a116e5d2-f007-46af-8a1b-6c4a877b553d', '604e16bc-8e0a-41ba-81dc-e614c45658dd', '2a959abf-f563-4420-ac1e-1b03c4d5129e', 'fd8e9ee3-775b-409d-ad2b-9425fe9cfb54'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:59:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] Lock "cinder-quobyte-4c60e30e-54fa-4ff3-a45a-777b4c03b66c" released by "_delete_snapshot" :: held 3.989s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] Lock "cinder-quobyte-4f78e712-ef85-42c4-af38-d71af35e387d" released by "delete_snapshot" :: held 4.024s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:57 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 03 23:59:57 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:57 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] Created reservations ['5bafea94-5c5d-4691-9fd1-d175f67153ee', 'e37625c6-363a-48f2-8cf5-826b75396c06', 'f4fa0c01-3604-441a-867c-ee3ea82eb137', '865fe689-c33a-4047-bb71-97d05b485175'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 23:59:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] Delete snapshot completed successfully. Jul 03 23:59:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-06e3c0b2-baa1-4c77-bee7-6fa575488c5c tempest-SnapshotMetadataTestJSON-538704340 None] Lock "cinder-4c60e30e-54fa-4ff3-a45a-777b4c03b66c-delete_snapshot" released by "delete_snapshot" :: held 4.327s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:58 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_vcc8ye3h" returned: 1 in 1.060s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_vcc8ye3h' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 23:59:58 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78324f1-e735-4c78-8331-dcc104f5928a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_jd8aslg0devstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:58 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.805s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:58 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 23:59:58 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_jd8aslg0devstack@QuobyteHD Jul 03 23:59:58 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] Deleted volume successfully. Jul 03 23:59:58 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4ab01b26-2f96-47a7-8998-c0a50fef5ddb tempest-VolumesActionsTest-1236879059 None] Lock "cinder-dbdc373a-e80b-4e97-ad57-037f28767fd1-delete_volume" released by "delete_volume" :: held 3.240s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 23:59:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] Acquiring lock "cinder-4f78e712-ef85-42c4-af38-d71af35e387d-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] Lock "cinder-4f78e712-ef85-42c4-af38-d71af35e387d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] Acquiring lock "cinder-quobyte-4f78e712-ef85-42c4-af38-d71af35e387d" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 23:59:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] Lock "cinder-quobyte-4f78e712-ef85-42c4-af38-d71af35e387d" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 23:59:58 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d537ec1-438d-40e3-8ade-ee74060efe38]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 23:59:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:59 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d Jul 03 23:59:59 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Flow 'volume_create_manager' (8d7b048f-23c2-4c5f-a435-c465cc5432d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 23:59:59 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd39b51-8d9d-4bf2-9c47-6f6f1ffae07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_jd8aslg0devstack@QuobyteHD" returned: 0 in 1.007s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 was qcow2, converting to raw {{(pid=86676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_jd8aslg0devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:59 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_jd8aslg0devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 Jul 03 23:59:59 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd39b51-8d9d-4bf2-9c47-6f6f1ffae07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1777032715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c02c65dc-87e1-46da-8351-1a2d70df76ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65043d2d4a6b4cd69596cb0297c04d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:59Z,use_quota=True,user_id='6711a8a687ea4cd181a9afe92b42c159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69736f4d-20c4-4254-820c-d2a1d8c9100a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69736f4d-20c4-4254-820c-d2a1d8c9100a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6686f5f-a06d-4a22-be59-d6e0afc705d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6686f5f-a06d-4a22-be59-d6e0afc705d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c02c65dc-87e1-46da-8351-1a2d70df76ef', 'volume_name': 'volume-c02c65dc-87e1-46da-8351-1a2d70df76ef', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11d10f4-dfd3-42aa-82c3-c678e5771f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11d10f4-dfd3-42aa-82c3-c678e5771f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89eb84ee-94c7-43b6-b3f3-d52a10062595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 23:59:59 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Volume c02c65dc-87e1-46da-8351-1a2d70df76ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c02c65dc-87e1-46da-8351-1a2d70df76ef', 'volume_size': 1} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T21:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1777032715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c02c65dc-87e1-46da-8351-1a2d70df76ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65043d2d4a6b4cd69596cb0297c04d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:59Z,use_quota=True,user_id='6711a8a687ea4cd181a9afe92b42c159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Creating volume c02c65dc-87e1-46da-8351-1a2d70df76ef {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 23:59:59 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c02c65dc-87e1-46da-8351-1a2d70df76ef 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:59 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c02c65dc-87e1-46da-8351-1a2d70df76ef 1073741824 Jul 03 23:59:59 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 23:59:59 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d" returned: 0 in 1.060s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 23:59:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 23:59:59 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d Jul 03 23:59:59 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:00 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c02c65dc-87e1-46da-8351-1a2d70df76ef 1073741824" returned: 0 in 0.969s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c02c65dc-87e1-46da-8351-1a2d70df76ef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:00 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c02c65dc-87e1-46da-8351-1a2d70df76ef Jul 04 00:00:00 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:00 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4f78e712-ef85-42c4-af38-d71af35e387d" returned: 0 in 0.812s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] Lock "cinder-quobyte-4f78e712-ef85-42c4-af38-d71af35e387d" released by "delete_volume" :: held 1.962s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:00 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] Created reservations ['39c4b577-bdad-43e1-879a-ea234b9aee3e', '4d2c37b9-b57f-40f0-9130-73a18791be97', '6f926eda-ef5f-426c-8970-f1e64364cdbf', '4a152308-ab12-4cb1-80ef-e6f36c13155d'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:00:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:01 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:00:01 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:01 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c02c65dc-87e1-46da-8351-1a2d70df76ef" returned: 0 in 0.848s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:00:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89eb84ee-94c7-43b6-b3f3-d52a10062595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c02c65dc-87e1-46da-8351-1a2d70df76ef', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78d6487-dbe5-4feb-8e97-5baea774c106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:01 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Volume volume-c02c65dc-87e1-46da-8351-1a2d70df76ef (c02c65dc-87e1-46da-8351-1a2d70df76ef): created successfully Jul 04 00:00:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78d6487-dbe5-4feb-8e97-5baea774c106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Flow 'volume_create_manager' (8d7b048f-23c2-4c5f-a435-c465cc5432d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-eb1f9f5d-5fc8-4cee-9fb2-d2bd602e534b tempest-VolumesActionsTest-430972961 None] Created volume successfully. Jul 04 00:00:01 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_jd8aslg0devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9" returned: 0 in 2.702s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:01 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_jd8aslg0devstack@QuobyteHD, size 112.00 MB, duration 2.70 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 04 00:00:01 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Converted 112.00 MB image at 41.43 MB/s Jul 04 00:00:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:01 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 1G Jul 04 00:00:01 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:01 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.996s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:01 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:00:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] Deleted volume successfully. Jul 04 00:00:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8fe7c034-9b58-40e1-ab81-d47f235b2480 tempest-SnapshotMetadataTestJSON-538704340 None] Lock "cinder-4f78e712-ef85-42c4-af38-d71af35e387d-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] Acquiring lock "cinder-c02c65dc-87e1-46da-8351-1a2d70df76ef-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] Lock "cinder-c02c65dc-87e1-46da-8351-1a2d70df76ef-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] Acquiring lock "cinder-quobyte-c02c65dc-87e1-46da-8351-1a2d70df76ef" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] Lock "cinder-quobyte-c02c65dc-87e1-46da-8351-1a2d70df76ef" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:02 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[108e1a11-14ef-4c8f-be80-704806f6ff74]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c02c65dc-87e1-46da-8351-1a2d70df76ef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:02 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c02c65dc-87e1-46da-8351-1a2d70df76ef Jul 04 00:00:02 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:03 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 1G" returned: 0 in 1.160s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecf6ae8-0c58-4873-9e8b-6b5150526107]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:03 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 Jul 04 00:00:03 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:03 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c02c65dc-87e1-46da-8351-1a2d70df76ef" returned: 0 in 1.280s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c02c65dc-87e1-46da-8351-1a2d70df76ef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:03 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c02c65dc-87e1-46da-8351-1a2d70df76ef Jul 04 00:00:03 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:04 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9" returned: 0 in 1.219s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:04 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 Jul 04 00:00:04 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:05 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c02c65dc-87e1-46da-8351-1a2d70df76ef" returned: 0 in 1.256s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] Lock "cinder-quobyte-c02c65dc-87e1-46da-8351-1a2d70df76ef" released by "delete_volume" :: held 2.609s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] Created reservations ['dcc54eb3-d0d3-4c17-8c2b-fb1220754a46', 'e32c5a68-4ebe-4953-848a-cf72572e833c', '30ff908c-daf6-468b-a908-3c18e57622ad', 'ef2aad37-7481-4ee8-89ed-5ced69efeecf'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:05 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:00:05 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:05 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9" returned: 1 in 1.349s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Downloaded image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 ((None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}])) to volume 45757270-bb9f-4278-bd0b-dd4e151598e9 successfully. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Temporary image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 for user 86b51b7ffd314859b8a1c337647a4889 is deleted. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Marking volume 45757270-bb9f-4278-bd0b-dd4e151598e9 as bootable. {{(pid=86676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Copying metadata from image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 to 45757270-bb9f-4278-bd0b-dd4e151598e9. {{(pid=86676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Creating volume glance metadata for volume 45757270-bb9f-4278-bd0b-dd4e151598e9 backed by image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a79555-a40e-4832-8de4-8bf333e79327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45757270-bb9f-4278-bd0b-dd4e151598e9', 'volume_size': 1, 'image_id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47a94a0f3bea4708b842e25ca5b22b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8491e9-e3e9-4225-845c-3513935c1bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:05 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Volume volume-45757270-bb9f-4278-bd0b-dd4e151598e9 (45757270-bb9f-4278-bd0b-dd4e151598e9): created successfully Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8491e9-e3e9-4225-845c-3513935c1bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Flow 'volume_create_manager' (cd4e4920-9ea0-4d0b-bdc2-043a06e7d14b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:05 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-281af97b-a845-46cf-8a79-08b99ea5d29c tempest-VolumesGetTest-1769109687 None] Created volume successfully. Jul 04 00:00:06 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.067s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:06 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:00:06 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] Deleted volume successfully. Jul 04 00:00:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3c7aecdb-61dd-4abf-b547-cae2da4dc94d tempest-VolumesActionsTest-1236879059 None] Lock "cinder-c02c65dc-87e1-46da-8351-1a2d70df76ef-delete_volume" released by "delete_volume" :: held 4.089s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:06 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:00:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Flow 'volume_create_manager' (fb00da56-93bc-48b6-9d46-21771864e5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d326ea5-6ff1-4a61-ae11-512c67952261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d326ea5-6ff1-4a61-ae11-512c67952261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1018162982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3e89a5-10d9-4fe2-836d-80a0f9935dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65043d2d4a6b4cd69596cb0297c04d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:07Z,use_quota=True,user_id='6711a8a687ea4cd181a9afe92b42c159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e65d62-51fe-4f43-9eb7-184e4052a6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e65d62-51fe-4f43-9eb7-184e4052a6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b28f4fe-0b59-4879-a561-8ad41fb3601c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b28f4fe-0b59-4879-a561-8ad41fb3601c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d3e89a5-10d9-4fe2-836d-80a0f9935dfe', 'volume_name': 'volume-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68185405-0682-41e7-9d88-8ed1c1fd294b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68185405-0682-41e7-9d88-8ed1c1fd294b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e085757-24ce-44e5-9083-e0be7e2dda91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:07 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Volume 2d3e89a5-10d9-4fe2-836d-80a0f9935dfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe', 'volume_size': 1} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1018162982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3e89a5-10d9-4fe2-836d-80a0f9935dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65043d2d4a6b4cd69596cb0297c04d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:07Z,use_quota=True,user_id='6711a8a687ea4cd181a9afe92b42c159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Creating volume 2d3e89a5-10d9-4fe2-836d-80a0f9935dfe {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:00:07 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:07 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe 1073741824 Jul 04 00:00:07 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Flow 'volume_create_manager' (afec3eca-6618-49e5-a961-cb7365c55c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba26a88d-2f40-4db9-87e3-73522c7729a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba26a88d-2f40-4db9-87e3-73522c7729a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-476940019',display_name='tempest-VolumesGetTest-Volume-578743879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034c3631-885b-47ef-81ea-f383a8e0c833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602cd61f822b4619b059d9e624ee4d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:07Z,use_quota=True,user_id='86b51b7ffd314859b8a1c337647a4889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f21a316-66e1-4961-9c83-96f64cc6c677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f21a316-66e1-4961-9c83-96f64cc6c677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0926952-226e-48c9-9873-deb542bedda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0926952-226e-48c9-9873-deb542bedda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '034c3631-885b-47ef-81ea-f383a8e0c833', 'volume_name': 'volume-034c3631-885b-47ef-81ea-f383a8e0c833', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6e083a-fd1a-45e2-9f26-a96ffd183a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6e083a-fd1a-45e2-9f26-a96ffd183a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2634453b-c124-4aa4-bf97-006c69b46da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:07 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Volume 034c3631-885b-47ef-81ea-f383a8e0c833: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-034c3631-885b-47ef-81ea-f383a8e0c833', 'volume_size': 1} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Flow 'volume_create_manager' (ce1adcfd-1c80-42e0-b982-88572568a670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b115f921-77b9-48ba-baba-989d7e0b2b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b115f921-77b9-48ba-baba-989d7e0b2b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-916119965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbe9600-1630-4bc5-b7b9-47f060f3ad84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c7ead993e83486585bdcfe952dd6798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:08Z,use_quota=True,user_id='0f11804b6aed477a8c02caee0dc9e616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004b3fcf-b55f-4233-9c9b-ecf54cacad8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004b3fcf-b55f-4233-9c9b-ecf54cacad8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed99c6fb-7f83-43c5-be23-23a6db2c3047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed99c6fb-7f83-43c5-be23-23a6db2c3047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffbe9600-1630-4bc5-b7b9-47f060f3ad84', 'volume_name': 'volume-ffbe9600-1630-4bc5-b7b9-47f060f3ad84', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2e364f-4f5f-452b-86d2-3515ee1e7666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2e364f-4f5f-452b-86d2-3515ee1e7666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0894646-bfe8-4b94-8e19-18350ee366d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:08 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Volume ffbe9600-1630-4bc5-b7b9-47f060f3ad84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffbe9600-1630-4bc5-b7b9-47f060f3ad84', 'volume_size': 1} Jul 04 00:00:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:08 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe 1073741824" returned: 0 in 1.064s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:08 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe Jul 04 00:00:08 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:08 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe" returned: 0 in 0.832s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:00:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.518s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-476940019',display_name='tempest-VolumesGetTest-Volume-578743879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034c3631-885b-47ef-81ea-f383a8e0c833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602cd61f822b4619b059d9e624ee4d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:07Z,use_quota=True,user_id='86b51b7ffd314859b8a1c337647a4889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Creating volume 034c3631-885b-47ef-81ea-f383a8e0c833 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:00:09 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-034c3631-885b-47ef-81ea-f383a8e0c833 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:09 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-034c3631-885b-47ef-81ea-f383a8e0c833 1073741824 Jul 04 00:00:09 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e085757-24ce-44e5-9083-e0be7e2dda91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77297b84-b734-4d32-b69d-d529c04baead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:09 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Volume volume-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe (2d3e89a5-10d9-4fe2-836d-80a0f9935dfe): created successfully Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77297b84-b734-4d32-b69d-d529c04baead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Flow 'volume_create_manager' (fb00da56-93bc-48b6-9d46-21771864e5b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d8e382cc-3dd7-40c9-aa64-40c0ccd25cbe tempest-VolumesActionsTest-430972961 None] Created volume successfully. Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Flow 'volume_create_manager' (4ea187ac-4c68-4ef2-aa83-363b46d2390f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aecb15f8-248d-4974-a0e3-8ce1c39e56f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aecb15f8-248d-4974-a0e3-8ce1c39e56f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-48440076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee0e061-a4cc-4f68-9df2-e79e08cd08bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f44bf73a1e3a4a51b51a4251f24b75d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:09Z,use_quota=True,user_id='eb5f08484c074c6ab33469a1f0a69322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3858616-f7a7-4541-ab5d-57cff8eca186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3858616-f7a7-4541-ab5d-57cff8eca186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61f00f7-ee0a-4499-954d-595fd9f9f50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61f00f7-ee0a-4499-954d-595fd9f9f50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ee0e061-a4cc-4f68-9df2-e79e08cd08bc', 'volume_name': 'volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540fea73-7c47-4f57-bcd6-60a6138ea1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540fea73-7c47-4f57-bcd6-60a6138ea1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29466de-0b9f-4a54-9cda-9454fb8891a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:09 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Volume 1ee0e061-a4cc-4f68-9df2-e79e08cd08bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc', 'volume_size': 1} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:09 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-034c3631-885b-47ef-81ea-f383a8e0c833 1073741824" returned: 0 in 0.930s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-034c3631-885b-47ef-81ea-f383a8e0c833 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:09 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-034c3631-885b-47ef-81ea-f383a8e0c833 Jul 04 00:00:09 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] Acquiring lock "cinder-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] Lock "cinder-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] Acquiring lock "cinder-quobyte-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] Lock "cinder-quobyte-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3437bf8f-6af2-4444-b5e3-4d8606595889]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:10 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe Jul 04 00:00:10 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:10 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-034c3631-885b-47ef-81ea-f383a8e0c833" returned: 0 in 0.709s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.618s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-916119965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbe9600-1630-4bc5-b7b9-47f060f3ad84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c7ead993e83486585bdcfe952dd6798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:08Z,use_quota=True,user_id='0f11804b6aed477a8c02caee0dc9e616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Creating volume ffbe9600-1630-4bc5-b7b9-47f060f3ad84 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:00:10 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ffbe9600-1630-4bc5-b7b9-47f060f3ad84 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:10 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ffbe9600-1630-4bc5-b7b9-47f060f3ad84 1073741824 Jul 04 00:00:10 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2634453b-c124-4aa4-bf97-006c69b46da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-034c3631-885b-47ef-81ea-f383a8e0c833', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c8e4f0-551a-4606-9f84-733708fa1d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:10 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Volume volume-034c3631-885b-47ef-81ea-f383a8e0c833 (034c3631-885b-47ef-81ea-f383a8e0c833): created successfully Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c8e4f0-551a-4606-9f84-733708fa1d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Flow 'volume_create_manager' (afec3eca-6618-49e5-a961-cb7365c55c95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e9f45f4e-8935-4b2b-9158-a855c1ca6d1f tempest-VolumesGetTest-1769109687 None] Created volume successfully. Jul 04 00:00:11 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe" returned: 0 in 0.818s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:11 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe Jul 04 00:00:11 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:11 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ffbe9600-1630-4bc5-b7b9-47f060f3ad84 1073741824" returned: 0 in 0.911s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ffbe9600-1630-4bc5-b7b9-47f060f3ad84 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:11 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ffbe9600-1630-4bc5-b7b9-47f060f3ad84 Jul 04 00:00:11 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:11 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe" returned: 0 in 0.746s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] Lock "cinder-quobyte-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe" released by "delete_volume" :: held 1.619s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] Acquiring lock "cinder-034c3631-885b-47ef-81ea-f383a8e0c833-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] Lock "cinder-034c3631-885b-47ef-81ea-f383a8e0c833-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] Acquiring lock "cinder-quobyte-034c3631-885b-47ef-81ea-f383a8e0c833" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:11 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] Created reservations ['c6dc0735-aa2b-4611-a195-7cdc5c83786a', '97267f69-660d-4575-a082-5fbe48aea7f8', 'b222f53c-6444-4886-9711-717870e0c2fe', '698361f5-64df-476c-a3e2-102d5ffec785'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:00:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] Lock "cinder-quobyte-034c3631-885b-47ef-81ea-f383a8e0c833" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:11 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[83da5ee8-23e4-4d79-9540-777a04b80fe8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-034c3631-885b-47ef-81ea-f383a8e0c833 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:12 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:00:12 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:12 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-034c3631-885b-47ef-81ea-f383a8e0c833 Jul 04 00:00:12 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:12 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ffbe9600-1630-4bc5-b7b9-47f060f3ad84" returned: 0 in 0.768s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-48440076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee0e061-a4cc-4f68-9df2-e79e08cd08bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f44bf73a1e3a4a51b51a4251f24b75d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:09Z,use_quota=True,user_id='eb5f08484c074c6ab33469a1f0a69322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Creating volume 1ee0e061-a4cc-4f68-9df2-e79e08cd08bc {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:00:12 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0894646-bfe8-4b94-8e19-18350ee366d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffbe9600-1630-4bc5-b7b9-47f060f3ad84', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:12 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc 1073741824 Jul 04 00:00:12 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19491370-c389-483e-8c2f-ad0f42e94431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:12 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Volume volume-ffbe9600-1630-4bc5-b7b9-47f060f3ad84 (ffbe9600-1630-4bc5-b7b9-47f060f3ad84): created successfully Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19491370-c389-483e-8c2f-ad0f42e94431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Flow 'volume_create_manager' (ce1adcfd-1c80-42e0-b982-88572568a670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:12 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f9de5741-d786-434f-823a-1a3bc276cc9f tempest-AbsoluteLimitsTests-576415098 None] Created volume successfully. Jul 04 00:00:12 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.901s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:00:12 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] Deleted volume successfully. Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-847b3335-c4cc-4eab-bf11-8f9b80754489 tempest-VolumesActionsTest-1236879059 None] Lock "cinder-2d3e89a5-10d9-4fe2-836d-80a0f9935dfe-delete_volume" released by "delete_volume" :: held 2.866s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:12 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-034c3631-885b-47ef-81ea-f383a8e0c833" returned: 0 in 1.037s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-034c3631-885b-47ef-81ea-f383a8e0c833 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:13 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-034c3631-885b-47ef-81ea-f383a8e0c833 Jul 04 00:00:13 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Flow 'volume_create_manager' (fb456520-ef75-496c-8e9d-2a3c7db48689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03aabf21-32b1-4ed4-83d1-5a782f4582d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03aabf21-32b1-4ed4-83d1-5a782f4582d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-909937929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bccad1f7-dfa0-48db-9afe-466f8b609e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65043d2d4a6b4cd69596cb0297c04d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:13Z,use_quota=True,user_id='6711a8a687ea4cd181a9afe92b42c159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83bccd9-814f-41ff-9dd8-9b4fbecc3c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83bccd9-814f-41ff-9dd8-9b4fbecc3c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec93bf3d-0149-4fdb-8b7c-57b83d60af4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec93bf3d-0149-4fdb-8b7c-57b83d60af4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bccad1f7-dfa0-48db-9afe-466f8b609e59', 'volume_name': 'volume-bccad1f7-dfa0-48db-9afe-466f8b609e59', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff43683-10d1-43cb-b1a5-ebc7c626dbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff43683-10d1-43cb-b1a5-ebc7c626dbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ad12bf-4bcc-46d8-a096-f73498d46204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:13 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Volume bccad1f7-dfa0-48db-9afe-466f8b609e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bccad1f7-dfa0-48db-9afe-466f8b609e59', 'volume_size': 1} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] Acquiring lock "cinder-ffbe9600-1630-4bc5-b7b9-47f060f3ad84-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] Lock "cinder-ffbe9600-1630-4bc5-b7b9-47f060f3ad84-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] Acquiring lock "cinder-quobyte-ffbe9600-1630-4bc5-b7b9-47f060f3ad84" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] Lock "cinder-quobyte-ffbe9600-1630-4bc5-b7b9-47f060f3ad84" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[37842f2b-da0b-4218-8c33-aaf4939ec03b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ffbe9600-1630-4bc5-b7b9-47f060f3ad84 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:13 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ffbe9600-1630-4bc5-b7b9-47f060f3ad84 Jul 04 00:00:13 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:13 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-034c3631-885b-47ef-81ea-f383a8e0c833" returned: 0 in 0.717s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] Lock "cinder-quobyte-034c3631-885b-47ef-81ea-f383a8e0c833" released by "delete_volume" :: held 1.810s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:13 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc 1073741824" returned: 0 in 1.265s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] Created reservations ['3ccb82de-1848-47c4-83b6-bc7c90f7d8f5', 'a04246f3-a689-4f45-a3db-a4fa518e776a', '3cd25b57-47ba-4980-9e65-a8b4219b3583', 'e7cf08ba-ebb8-4090-b62a-fa600b1094d4'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:13 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc Jul 04 00:00:13 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:13 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:00:13 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] Acquiring lock "cinder-45757270-bb9f-4278-bd0b-dd4e151598e9-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] Lock "cinder-45757270-bb9f-4278-bd0b-dd4e151598e9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] Acquiring lock "cinder-quobyte-45757270-bb9f-4278-bd0b-dd4e151598e9" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] Lock "cinder-quobyte-45757270-bb9f-4278-bd0b-dd4e151598e9" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a911786-f8ed-4b34-9b42-eff5a4d89c7e]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:14 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ffbe9600-1630-4bc5-b7b9-47f060f3ad84" returned: 0 in 1.058s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ffbe9600-1630-4bc5-b7b9-47f060f3ad84 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:14 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 Jul 04 00:00:14 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:14 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ffbe9600-1630-4bc5-b7b9-47f060f3ad84 Jul 04 00:00:14 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:14 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc" returned: 0 in 0.903s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] <== create_volume: return (2226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.231s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.630s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-909937929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bccad1f7-dfa0-48db-9afe-466f8b609e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65043d2d4a6b4cd69596cb0297c04d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:13Z,use_quota=True,user_id='6711a8a687ea4cd181a9afe92b42c159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Creating volume bccad1f7-dfa0-48db-9afe-466f8b609e59 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:00:14 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bccad1f7-dfa0-48db-9afe-466f8b609e59 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:14 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bccad1f7-dfa0-48db-9afe-466f8b609e59 1073741824 Jul 04 00:00:14 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29466de-0b9f-4a54-9cda-9454fb8891a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4a9025-a435-4e5f-a622-364201b5fb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:14 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.975s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:00:14 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] Deleted volume successfully. Jul 04 00:00:14 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Volume volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc (1ee0e061-a4cc-4f68-9df2-e79e08cd08bc): created successfully Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4a9025-a435-4e5f-a622-364201b5fb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Flow 'volume_create_manager' (4ea187ac-4c68-4ef2-aa83-363b46d2390f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:14 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c02400d9-d285-49f8-b03e-e342a3b05687 tempest-VolumesSnapshotTestJSON-832763818 None] Created volume successfully. Jul 04 00:00:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c0e90a50-865e-4041-a77f-20aead8f8282 tempest-VolumesGetTest-1769109687 None] Lock "cinder-034c3631-885b-47ef-81ea-f383a8e0c833-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:15 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9" returned: 0 in 1.086s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:15 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ffbe9600-1630-4bc5-b7b9-47f060f3ad84" returned: 0 in 1.031s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] Lock "cinder-quobyte-ffbe9600-1630-4bc5-b7b9-47f060f3ad84" released by "delete_volume" :: held 2.142s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:15 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 Jul 04 00:00:15 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:15 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] Created reservations ['7e740c89-12a9-46f9-abda-a3a1d96069a6', '2442211f-aa59-4340-88cf-51a1c1dca7b6', '7e343a0c-f41a-4c9d-9540-02f95e740ef7', '15a29329-0c5a-4ea7-810e-3de77c2e74c9'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:00:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:15 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:00:15 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:15 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bccad1f7-dfa0-48db-9afe-466f8b609e59 1073741824" returned: 0 in 1.191s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bccad1f7-dfa0-48db-9afe-466f8b609e59 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:16 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bccad1f7-dfa0-48db-9afe-466f8b609e59 Jul 04 00:00:16 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-42a0b8a6-19f4-40be-8d8c-5a3a5cb375e7 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:16 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9" returned: 1 in 1.121s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:00:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:16 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9 Jul 04 00:00:16 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:16 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.024s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:16 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:00:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] Deleted volume successfully. Jul 04 00:00:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e4e23f9d-3472-4ad5-8a97-99603c6b2d6a tempest-AbsoluteLimitsTests-576415098 None] Lock "cinder-ffbe9600-1630-4bc5-b7b9-47f060f3ad84-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:16 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bccad1f7-dfa0-48db-9afe-466f8b609e59" returned: 0 in 0.972s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] <== create_volume: return (2227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:00:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.233s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-42a0b8a6-19f4-40be-8d8c-5a3a5cb375e7 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.433s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ad12bf-4bcc-46d8-a096-f73498d46204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bccad1f7-dfa0-48db-9afe-466f8b609e59', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d086fb-d613-482a-b9e8-0b15faf097c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-42a0b8a6-19f4-40be-8d8c-5a3a5cb375e7 tempest-VolumesSnapshotTestJSON-832763818 None] Creating offline snapshot fd57ba68-1bf1-4d81-8a6a-5cf271c97c99 of volume 1ee0e061-a4cc-4f68-9df2-e79e08cd08bc {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:00:17 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Volume volume-bccad1f7-dfa0-48db-9afe-466f8b609e59 (bccad1f7-dfa0-48db-9afe-466f8b609e59): created successfully Jul 04 00:00:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d086fb-d613-482a-b9e8-0b15faf097c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Flow 'volume_create_manager' (fb456520-ef75-496c-8e9d-2a3c7db48689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:17 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[70125296-3e52-43e7-bd51-e56350d42fa9]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42a0b8a6-19f4-40be-8d8c-5a3a5cb375e7 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:17 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3e7c8f7b-7634-4fa5-a018-2a802ce99d22 tempest-VolumesActionsTest-430972961 None] Created volume successfully. Jul 04 00:00:17 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc Jul 04 00:00:17 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:17 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45757270-bb9f-4278-bd0b-dd4e151598e9" returned: 0 in 0.812s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] Lock "cinder-quobyte-45757270-bb9f-4278-bd0b-dd4e151598e9" released by "delete_volume" :: held 3.132s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:17 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] Created reservations ['795a38e8-3a88-48e2-aa10-eb44a9ca805a', '1001941e-0a16-45e0-958b-bcec3b8efa26', '5f30ace9-ba02-44c9-aeff-c7dd37955dd8', 'cabd362e-7ddd-473d-ab8c-57b360b3b2e0'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:00:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:17 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:00:17 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:18 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42a0b8a6-19f4-40be-8d8c-5a3a5cb375e7 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc" returned: 0 in 1.123s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42a0b8a6-19f4-40be-8d8c-5a3a5cb375e7 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:18 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99 1G Jul 04 00:00:18 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] Acquiring lock "cinder-bccad1f7-dfa0-48db-9afe-466f8b609e59-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] Lock "cinder-bccad1f7-dfa0-48db-9afe-466f8b609e59-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] Acquiring lock "cinder-quobyte-bccad1f7-dfa0-48db-9afe-466f8b609e59" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] Lock "cinder-quobyte-bccad1f7-dfa0-48db-9afe-466f8b609e59" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:18 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dc751a-ea84-468f-aa0c-15f50337ae4e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bccad1f7-dfa0-48db-9afe-466f8b609e59 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:18 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.974s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:18 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:00:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] Deleted volume successfully. Jul 04 00:00:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-87aed2d6-d955-4f60-a0d8-efdf893fde20 tempest-VolumesGetTest-1769109687 None] Lock "cinder-45757270-bb9f-4278-bd0b-dd4e151598e9-delete_volume" released by "delete_volume" :: held 4.441s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:18 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bccad1f7-dfa0-48db-9afe-466f8b609e59 Jul 04 00:00:18 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:19 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42a0b8a6-19f4-40be-8d8c-5a3a5cb375e7 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99 1G" returned: 0 in 1.216s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42a0b8a6-19f4-40be-8d8c-5a3a5cb375e7 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:19 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99 Jul 04 00:00:19 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:19 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bccad1f7-dfa0-48db-9afe-466f8b609e59" returned: 0 in 1.167s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bccad1f7-dfa0-48db-9afe-466f8b609e59 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:19 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bccad1f7-dfa0-48db-9afe-466f8b609e59 Jul 04 00:00:19 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:20 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42a0b8a6-19f4-40be-8d8c-5a3a5cb375e7 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99" returned: 0 in 1.017s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:20 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-42a0b8a6-19f4-40be-8d8c-5a3a5cb375e7 tempest-VolumesSnapshotTestJSON-832763818 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99 is being set with open permissions: ugo+rw Jul 04 00:00:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42a0b8a6-19f4-40be-8d8c-5a3a5cb375e7 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:20 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99 Jul 04 00:00:20 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:20 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bccad1f7-dfa0-48db-9afe-466f8b609e59" returned: 0 in 0.837s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] Lock "cinder-quobyte-bccad1f7-dfa0-48db-9afe-466f8b609e59" released by "delete_volume" :: held 2.082s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:20 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] Created reservations ['9c521707-5212-4f0a-8120-c310b0907594', 'e7f9ecf3-5c5e-46a3-9439-5bea4ecbaed6', 'fb4d1470-d03c-4391-adc6-bbd628f90654', 'e24ec851-32b8-4e6b-a9b3-66a1e02c1507'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:00:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:20 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:00:20 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:21 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42a0b8a6-19f4-40be-8d8c-5a3a5cb375e7 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99" returned: 0 in 0.771s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42a0b8a6-19f4-40be-8d8c-5a3a5cb375e7 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:21 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.info Jul 04 00:00:21 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:21 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.817s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:21 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:00:21 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] Deleted volume successfully. Jul 04 00:00:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cec6f56c-6629-4817-8ab7-59c547901337 tempest-VolumesActionsTest-430972961 None] Lock "cinder-bccad1f7-dfa0-48db-9afe-466f8b609e59-delete_volume" released by "delete_volume" :: held 3.283s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:22 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42a0b8a6-19f4-40be-8d8c-5a3a5cb375e7 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.info" returned: 0 in 0.925s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:22 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-42a0b8a6-19f4-40be-8d8c-5a3a5cb375e7 tempest-VolumesSnapshotTestJSON-832763818 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.info is being set with open permissions: ugo+rw Jul 04 00:00:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42a0b8a6-19f4-40be-8d8c-5a3a5cb375e7 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:22 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.info Jul 04 00:00:22 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:22 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:00:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Flow 'volume_create_manager' (66a21251-14a9-432c-bdcb-7a36e2266f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a105f6-1ad1-423a-a604-b781d762d0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a105f6-1ad1-423a-a604-b781d762d0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-178372137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26466adc-7ac8-4b3d-b5a9-e8d46116ef49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8338c989f1dd4cacbe16515e3948aceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:23Z,use_quota=True,user_id='e49f63d7845847bba095c841b3edd036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e601fe6f-28ed-485c-93b1-a2611677a55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e601fe6f-28ed-485c-93b1-a2611677a55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec4478b-f72e-41a1-bcc8-11ace599d54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec4478b-f72e-41a1-bcc8-11ace599d54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26466adc-7ac8-4b3d-b5a9-e8d46116ef49', 'volume_name': 'volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49', 'volume_size': 2}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51256c2e-3cf6-4140-82b4-71f6f9526b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51256c2e-3cf6-4140-82b4-71f6f9526b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f105679-bd52-4c7b-93fe-de63baf3924e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:23 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Volume 26466adc-7ac8-4b3d-b5a9-e8d46116ef49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49', 'volume_size': 2} Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:23 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42a0b8a6-19f4-40be-8d8c-5a3a5cb375e7 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.info" returned: 0 in 1.013s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-42a0b8a6-19f4-40be-8d8c-5a3a5cb375e7 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.205s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.146s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-178372137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26466adc-7ac8-4b3d-b5a9-e8d46116ef49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8338c989f1dd4cacbe16515e3948aceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:23Z,use_quota=True,user_id='e49f63d7845847bba095c841b3edd036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Creating volume 26466adc-7ac8-4b3d-b5a9-e8d46116ef49 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:00:23 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:00:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49 2147483648 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:23 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49 2147483648 Jul 04 00:00:23 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:23 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-42a0b8a6-19f4-40be-8d8c-5a3a5cb375e7 tempest-VolumesSnapshotTestJSON-832763818 None] Create snapshot completed successfully Jul 04 00:00:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-fd57ba68-1bf1-4d81-8a6a-5cf271c97c99-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-fd57ba68-1bf1-4d81-8a6a-5cf271c97c99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-quobyte-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-quobyte-fd57ba68-1bf1-4d81-8a6a-5cf271c97c99" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-fd57ba68-1bf1-4d81-8a6a-5cf271c97c99" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] Deleting offline snapshot fd57ba68-1bf1-4d81-8a6a-5cf271c97c99 of volume 1ee0e061-a4cc-4f68-9df2-e79e08cd08bc {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:00:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] snapshot_file for this snap is: volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:00:24 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[824d649a-289c-4990-8836-36d4405eb516]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:24 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49 2147483648" returned: 0 in 1.298s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:24 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99 Jul 04 00:00:24 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:24 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49 Jul 04 00:00:24 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Flow 'volume_create_manager' (878733ec-8092-4477-8119-fad0190d5ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:25 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5983b43a-3387-4f9d-936f-0a6ad808f933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99" returned: 0 in 1.094s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5983b43a-3387-4f9d-936f-0a6ad808f933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2071047050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9e1eca-7545-4aa1-bb28-26fa3996f6c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ed18bed30174b96a1f75ca79f10c5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:25Z,use_quota=True,user_id='2cdf33a2483546399cd82e5c4cbab60c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa0c9ca-f43e-4015-ba82-c08c0cd4ab17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa0c9ca-f43e-4015-ba82-c08c0cd4ab17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524617a3-a1f3-4109-bf21-7c9968030888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:25 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524617a3-a1f3-4109-bf21-7c9968030888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f9e1eca-7545-4aa1-bb28-26fa3996f6c7', 'volume_name': 'volume-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c0edc5-0226-4961-82cc-0878b07d469c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c0edc5-0226-4961-82cc-0878b07d469c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f46e0f6-e013-47f7-8ba1-5616be36b899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:25 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Volume 7f9e1eca-7545-4aa1-bb28-26fa3996f6c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7', 'volume_size': 1} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[01506f4e-9339-453a-bcdd-8b460a168ac8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49" returned: 0 in 0.997s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] <== create_volume: return (2360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.367s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.018s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2071047050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9e1eca-7545-4aa1-bb28-26fa3996f6c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ed18bed30174b96a1f75ca79f10c5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:25Z,use_quota=True,user_id='2cdf33a2483546399cd82e5c4cbab60c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Creating volume 7f9e1eca-7545-4aa1-bb28-26fa3996f6c7 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:00:25 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:25 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7 1073741824 Jul 04 00:00:25 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f105679-bd52-4c7b-93fe-de63baf3924e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49', 'volume_size': 2}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8660903-dcd7-41df-a8ea-bc216615eaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:25 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Volume volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49 (26466adc-7ac8-4b3d-b5a9-e8d46116ef49): created successfully Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8660903-dcd7-41df-a8ea-bc216615eaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Flow 'volume_create_manager' (66a21251-14a9-432c-bdcb-7a36e2266f1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:25 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-77b24220-8f9d-4c89-b275-adf080b1e4e7 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Created volume successfully. Jul 04 00:00:25 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc Jul 04 00:00:25 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:26 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=177,cinder:SELECT=127,cinder:INSERT=49,cinder:DELETE=18 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:00:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1039db21-55a0-46b8-90ce-86689ed30382 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:26 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc" returned: 0 in 1.084s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:26 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99 Jul 04 00:00:26 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:26 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7 1073741824" returned: 0 in 1.170s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:26 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7 Jul 04 00:00:26 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:27 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:27 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99" returned: 0 in 1.042s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7" returned: 0 in 0.883s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] <== create_volume: return (2118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:00:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1039db21-55a0-46b8-90ce-86689ed30382 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.280s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:27 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99 Jul 04 00:00:27 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1039db21-55a0-46b8-90ce-86689ed30382 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Creating offline snapshot 4f80b69c-6bc9-46fb-878b-8ca6401b02da of volume 26466adc-7ac8-4b3d-b5a9-e8d46116ef49 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:00:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f46e0f6-e013-47f7-8ba1-5616be36b899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a01deee-b48a-42c2-8d44-63b07a5efd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:27 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4001194-d56b-4af4-bad6-e0e6aa35d8e0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1039db21-55a0-46b8-90ce-86689ed30382 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:27 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Volume volume-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7 (7f9e1eca-7545-4aa1-bb28-26fa3996f6c7): created successfully Jul 04 00:00:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a01deee-b48a-42c2-8d44-63b07a5efd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Flow 'volume_create_manager' (878733ec-8092-4477-8119-fad0190d5ae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e312558b-3d30-48a2-a5ea-93a34f3c07fd tempest-VolumesListTestJSON-810921438 None] Created volume successfully. Jul 04 00:00:27 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49 Jul 04 00:00:27 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:28 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc.fd57ba68-1bf1-4d81-8a6a-5cf271c97c99" returned: 0 in 0.866s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-fd57ba68-1bf1-4d81-8a6a-5cf271c97c99" released by "_delete_snapshot" :: held 4.263s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc" released by "delete_snapshot" :: held 4.292s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:28 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:28 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] Created reservations ['efc66227-2749-4f52-95d6-09bddb8596e2', 'd316c0ad-6062-4277-b05c-ee866e0144e4', '6ccafe2b-1f7b-4cfe-8822-3f912d5b843c', 'a990ff59-6a71-4acf-a456-7c3064f095b8'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:00:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1039db21-55a0-46b8-90ce-86689ed30382 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49" returned: 0 in 0.932s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1039db21-55a0-46b8-90ce-86689ed30382 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da 2G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:28 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da 2G Jul 04 00:00:28 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:28 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] Delete snapshot completed successfully. Jul 04 00:00:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-af907e64-ef16-4603-a840-05673d4cf270 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-fd57ba68-1bf1-4d81-8a6a-5cf271c97c99-delete_snapshot" released by "delete_snapshot" :: held 4.564s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:29 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:00:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Flow 'volume_create_manager' (73e933c3-09cf-4e31-86e0-ae8eee636f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5fd295-b587-461c-b226-c3c20ff96491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5fd295-b587-461c-b226-c3c20ff96491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1327195678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062508fe-caeb-40d9-8d60-0c45eef135c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ed18bed30174b96a1f75ca79f10c5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:29Z,use_quota=True,user_id='2cdf33a2483546399cd82e5c4cbab60c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822dd6da-4b0b-48be-875c-5eeab6cbf241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822dd6da-4b0b-48be-875c-5eeab6cbf241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4acb29-fc04-49f2-a4f5-63fead00a151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4acb29-fc04-49f2-a4f5-63fead00a151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '062508fe-caeb-40d9-8d60-0c45eef135c2', 'volume_name': 'volume-062508fe-caeb-40d9-8d60-0c45eef135c2', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c560d07d-fc0c-4d8d-a94c-d7e4940a2b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c560d07d-fc0c-4d8d-a94c-d7e4940a2b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be18afc4-f224-44bd-9096-61fd428e62c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:29 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Volume 062508fe-caeb-40d9-8d60-0c45eef135c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-062508fe-caeb-40d9-8d60-0c45eef135c2', 'volume_size': 1} Jul 04 00:00:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:29 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1039db21-55a0-46b8-90ce-86689ed30382 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da 2G" returned: 0 in 1.206s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1039db21-55a0-46b8-90ce-86689ed30382 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:29 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da Jul 04 00:00:29 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:30 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:00:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Flow 'volume_create_manager' (b3475cfe-86fa-47ff-91a0-4d0b9d592ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ecc2b6b-3f1c-402c-a240-7d2e3f5c38db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ecc2b6b-3f1c-402c-a240-7d2e3f5c38db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1976587517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f44bf73a1e3a4a51b51a4251f24b75d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:30Z,use_quota=True,user_id='eb5f08484c074c6ab33469a1f0a69322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e80e0d38-a65a-4fdb-9b31-1de1b9c5cb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e80e0d38-a65a-4fdb-9b31-1de1b9c5cb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410faf8f-3885-42be-a206-86d93fd0a266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410faf8f-3885-42be-a206-86d93fd0a266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577', 'volume_name': 'volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547eb40a-7ef7-41b0-94c9-f8d81af9910f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547eb40a-7ef7-41b0-94c9-f8d81af9910f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efbc43ba-f075-44b2-8a05-6ab97166ef80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:30 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Volume 8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577', 'volume_size': 1} Jul 04 00:00:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:30 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1039db21-55a0-46b8-90ce-86689ed30382 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da" returned: 0 in 0.871s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:30 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-1039db21-55a0-46b8-90ce-86689ed30382 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da is being set with open permissions: ugo+rw Jul 04 00:00:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1039db21-55a0-46b8-90ce-86689ed30382 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:30 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da Jul 04 00:00:30 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:31 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1039db21-55a0-46b8-90ce-86689ed30382 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da" returned: 0 in 0.791s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1039db21-55a0-46b8-90ce-86689ed30382 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:31 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.info Jul 04 00:00:31 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:32 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1039db21-55a0-46b8-90ce-86689ed30382 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.info" returned: 0 in 0.792s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:32 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-1039db21-55a0-46b8-90ce-86689ed30382 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.info is being set with open permissions: ugo+rw Jul 04 00:00:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1039db21-55a0-46b8-90ce-86689ed30382 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:32 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.info Jul 04 00:00:32 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:33 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1039db21-55a0-46b8-90ce-86689ed30382 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.info" returned: 0 in 0.695s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1039db21-55a0-46b8-90ce-86689ed30382 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.404s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.682s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1327195678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062508fe-caeb-40d9-8d60-0c45eef135c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ed18bed30174b96a1f75ca79f10c5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:29Z,use_quota=True,user_id='2cdf33a2483546399cd82e5c4cbab60c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Creating volume 062508fe-caeb-40d9-8d60-0c45eef135c2 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:00:33 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062508fe-caeb-40d9-8d60-0c45eef135c2 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:33 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062508fe-caeb-40d9-8d60-0c45eef135c2 1073741824 Jul 04 00:00:33 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:33 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1039db21-55a0-46b8-90ce-86689ed30382 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Create snapshot completed successfully Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=154,cinder:SELECT=117,cinder:INSERT=42,cinder:DELETE=10 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:33 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:00:33 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Acquiring lock "cinder-4f80b69c-6bc9-46fb-878b-8ca6401b02da-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Lock "cinder-4f80b69c-6bc9-46fb-878b-8ca6401b02da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Acquiring lock "cinder-quobyte-26466adc-7ac8-4b3d-b5a9-e8d46116ef49" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Lock "cinder-quobyte-26466adc-7ac8-4b3d-b5a9-e8d46116ef49" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Acquiring lock "cinder-quobyte-4f80b69c-6bc9-46fb-878b-8ca6401b02da" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Lock "cinder-quobyte-4f80b69c-6bc9-46fb-878b-8ca6401b02da" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Deleting offline snapshot 4f80b69c-6bc9-46fb-878b-8ca6401b02da of volume 26466adc-7ac8-4b3d-b5a9-e8d46116ef49 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] snapshot_file for this snap is: volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5056c4-9cd8-40f3-979e-781419124123]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:34 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da Jul 04 00:00:34 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:34 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062508fe-caeb-40d9-8d60-0c45eef135c2 1073741824" returned: 0 in 1.015s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062508fe-caeb-40d9-8d60-0c45eef135c2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:34 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.805s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:00:34 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062508fe-caeb-40d9-8d60-0c45eef135c2 Jul 04 00:00:34 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:00:34 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062508fe-caeb-40d9-8d60-0c45eef135c2" returned: 0 in 0.658s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.459s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1976587517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f44bf73a1e3a4a51b51a4251f24b75d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:30Z,use_quota=True,user_id='eb5f08484c074c6ab33469a1f0a69322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Creating volume 8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:00:34 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:34 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da" returned: 0 in 0.887s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:00:34 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 1073741824 Jul 04 00:00:34 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be18afc4-f224-44bd-9096-61fd428e62c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-062508fe-caeb-40d9-8d60-0c45eef135c2', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7af253-c89a-4d70-9565-d8f55ea82848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[16836fc9-7659-4c16-b31a-bf8a6c022ef4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:34 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Volume volume-062508fe-caeb-40d9-8d60-0c45eef135c2 (062508fe-caeb-40d9-8d60-0c45eef135c2): created successfully Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7af253-c89a-4d70-9565-d8f55ea82848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Flow 'volume_create_manager' (73e933c3-09cf-4e31-86e0-ae8eee636f17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:34 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1160918c-83d2-4187-ac40-005e392fdd66 tempest-VolumesListTestJSON-810921438 None] Created volume successfully. Jul 04 00:00:35 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49 Jul 04 00:00:35 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:35 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 1073741824" returned: 0 in 0.966s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:35 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 Jul 04 00:00:35 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:35 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49" returned: 0 in 1.009s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:35 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da Jul 04 00:00:35 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Flow 'volume_create_manager' (84d20866-4529-4bf7-98f8-5636de6b06a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bec48b9-5a89-4fb0-811b-f7551cc451d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bec48b9-5a89-4fb0-811b-f7551cc451d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1140464909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969c5517-7171-4970-9920-3fb957df88ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e923800e6545dc9c830a3b1242771b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:36Z,use_quota=True,user_id='8cb18d0084ee41968bd14408feedd16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec331ad-377a-4e2b-bfa8-afa5a7af97b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec331ad-377a-4e2b-bfa8-afa5a7af97b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29e20b0-66dd-418d-b8f0-7ecd0a051082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.image.glance [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Creating Keystone auth plugin from conf {{(pid=86676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Flow 'volume_create_manager' (80581f99-f714-46ea-9e87-d6246d11b17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544f291e-3897-4493-a6dd-d4575cd3a0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544f291e-3897-4493-a6dd-d4575cd3a0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-903314177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062ff848-1f0d-4236-a7cd-28f1001d220a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ed18bed30174b96a1f75ca79f10c5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:36Z,use_quota=True,user_id='2cdf33a2483546399cd82e5c4cbab60c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b64643-6190-442f-96dc-ccea151731a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b64643-6190-442f-96dc-ccea151731a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3089fe-2b41-4cd9-866e-bffcffd64ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3089fe-2b41-4cd9-866e-bffcffd64ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '062ff848-1f0d-4236-a7cd-28f1001d220a', 'volume_name': 'volume-062ff848-1f0d-4236-a7cd-28f1001d220a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e212e9-bc84-406d-acf7-717eaf22feca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e212e9-bc84-406d-acf7-717eaf22feca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487dcb01-3b26-48f8-a0a9-681025c7d526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:36 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Volume 062ff848-1f0d-4236-a7cd-28f1001d220a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-062ff848-1f0d-4236-a7cd-28f1001d220a', 'volume_size': 1} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29e20b0-66dd-418d-b8f0-7ecd0a051082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '969c5517-7171-4970-9920-3fb957df88ed', 'volume_name': 'volume-969c5517-7171-4970-9920-3fb957df88ed', 'volume_size': 1, 'image_id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47a94a0f3bea4708b842e25ca5b22b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9bbd6f-1a96-4a05-a289-9a34c855ee30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9bbd6f-1a96-4a05-a289-9a34c855ee30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9198d83a-87b4-4e7a-987d-2467b44b9f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:36 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Volume 969c5517-7171-4970-9920-3fb957df88ed: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-969c5517-7171-4970-9920-3fb957df88ed', 'volume_size': 1, 'image_id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47a94a0f3bea4708b842e25ca5b22b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Trying to clone 969c5517-7171-4970-9920-3fb957df88ed from image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}]). {{(pid=86676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 04 00:00:36 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577" returned: 0 in 1.123s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] <== create_volume: return (2134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.136s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.254s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-903314177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062ff848-1f0d-4236-a7cd-28f1001d220a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ed18bed30174b96a1f75ca79f10c5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:36Z,use_quota=True,user_id='2cdf33a2483546399cd82e5c4cbab60c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Creating volume 062ff848-1f0d-4236-a7cd-28f1001d220a {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:00:36 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:00:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062ff848-1f0d-4236-a7cd-28f1001d220a 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:37 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062ff848-1f0d-4236-a7cd-28f1001d220a 1073741824 Jul 04 00:00:37 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efbc43ba-f075-44b2-8a05-6ab97166ef80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:37 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb5b6f1-9188-48bc-ac8d-1c8ba611dcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da" returned: 0 in 1.133s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:37 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Volume volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 (8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577): created successfully Jul 04 00:00:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb5b6f1-9188-48bc-ac8d-1c8ba611dcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:37 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da Jul 04 00:00:37 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Flow 'volume_create_manager' (b3475cfe-86fa-47ff-91a0-4d0b9d592ff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:37 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-cd7f3251-08a4-4275-8666-e089fb22b747 tempest-VolumesSnapshotTestJSON-832763818 None] Created volume successfully. Jul 04 00:00:37 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_pl1b5na2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 04 00:00:37 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Image download 20.69 MB at 20.69 MB/s Jul 04 00:00:37 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd5e0dc-a077-4d97-92c9-ec46104d9304]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_pl1b5na2devstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:37 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_pl1b5na2devstack@QuobyteHD Jul 04 00:00:37 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:37 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f45f0dab-18c4-43f2-b1b2-538d20adbcb1 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49.4f80b69c-6bc9-46fb-878b-8ca6401b02da" returned: 0 in 0.839s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Lock "cinder-quobyte-4f80b69c-6bc9-46fb-878b-8ca6401b02da" released by "_delete_snapshot" :: held 4.023s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Lock "cinder-quobyte-26466adc-7ac8-4b3d-b5a9-e8d46116ef49" released by "delete_snapshot" :: held 4.051s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:37 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062ff848-1f0d-4236-a7cd-28f1001d220a 1073741824" returned: 0 in 1.004s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062ff848-1f0d-4236-a7cd-28f1001d220a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Created reservations ['4a4573a1-45af-4111-a283-eba9cd765f25', '6cebde31-98e1-459e-9592-8f704350c883', '5296a193-156b-4f94-b4ff-8664c28ed10d', 'b48d050f-6d7d-4462-9f96-92c4e9d509f9'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:00:38 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062ff848-1f0d-4236-a7cd-28f1001d220a Jul 04 00:00:38 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:38 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_pl1b5na2devstack@QuobyteHD" returned: 0 in 0.827s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Temporary image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 is fetched for user 8cb18d0084ee41968bd14408feedd16e. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 04 00:00:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Delete snapshot completed successfully. Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5151e46-aead-4ce1-8107-fde84b4d9650 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Lock "cinder-4f80b69c-6bc9-46fb-878b-8ca6401b02da-delete_snapshot" released by "delete_snapshot" :: held 4.265s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd85438f-f701-4dbd-bc54-485ec2431f4d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_pl1b5na2devstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Acquiring lock "cinder-26466adc-7ac8-4b3d-b5a9-e8d46116ef49-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Lock "cinder-26466adc-7ac8-4b3d-b5a9-e8d46116ef49-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Acquiring lock "cinder-quobyte-26466adc-7ac8-4b3d-b5a9-e8d46116ef49" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Lock "cinder-quobyte-26466adc-7ac8-4b3d-b5a9-e8d46116ef49" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:38 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_pl1b5na2devstack@QuobyteHD Jul 04 00:00:38 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f29f2f-7e26-43d2-8b6c-7a7011fedbfb]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:38 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49 Jul 04 00:00:38 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:38 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062ff848-1f0d-4236-a7cd-28f1001d220a" returned: 0 in 0.756s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f45f0dab-18c4-43f2-b1b2-538d20adbcb1 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.887s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487dcb01-3b26-48f8-a0a9-681025c7d526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-062ff848-1f0d-4236-a7cd-28f1001d220a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c84ebe-c7d9-4a4d-9c44-437611047215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-f45f0dab-18c4-43f2-b1b2-538d20adbcb1 tempest-VolumesSnapshotTestJSON-832763818 None] Creating offline snapshot 4dcc80a4-2907-43c5-ae4b-dcae207afa9c of volume 8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:00:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Volume volume-062ff848-1f0d-4236-a7cd-28f1001d220a (062ff848-1f0d-4236-a7cd-28f1001d220a): created successfully Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c84ebe-c7d9-4a4d-9c44-437611047215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Flow 'volume_create_manager' (80581f99-f714-46ea-9e87-d6246d11b17c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a1a980-2b9a-46d3-9102-ada34326d10f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f45f0dab-18c4-43f2-b1b2-538d20adbcb1 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-31fe5d79-ab16-40f1-9f51-5d241a84b69e tempest-VolumesListTestJSON-810921438 None] Created volume successfully. Jul 04 00:00:38 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 Jul 04 00:00:38 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:39 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_pl1b5na2devstack@QuobyteHD" returned: 0 in 0.830s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:39 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49" returned: 0 in 0.809s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:39 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49 Jul 04 00:00:39 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:39 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f45f0dab-18c4-43f2-b1b2-538d20adbcb1 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577" returned: 0 in 0.849s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f45f0dab-18c4-43f2-b1b2-538d20adbcb1 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:39 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c 1G Jul 04 00:00:39 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:39 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-26466adc-7ac8-4b3d-b5a9-e8d46116ef49" returned: 0 in 0.646s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Lock "cinder-quobyte-26466adc-7ac8-4b3d-b5a9-e8d46116ef49" released by "delete_volume" :: held 1.535s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:39 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Created reservations ['63717ce8-bb4c-434b-a6f0-dd09a5956606', '54e99f96-7cec-4030-9b1d-235a42a43b66', '9696c151-8948-4d2e-adaf-fb1d1d855f4a', '9e16ffb2-f52f-408b-bcdf-449ffdc8bdf9'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:00:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:40 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:00:40 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:40 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f45f0dab-18c4-43f2-b1b2-538d20adbcb1 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c 1G" returned: 0 in 0.958s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f45f0dab-18c4-43f2-b1b2-538d20adbcb1 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:40 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c Jul 04 00:00:40 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:40 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.822s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:40 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:00:40 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Deleted volume successfully. Jul 04 00:00:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-00f0cb55-e2d7-468f-8abe-fcb399ceb217 tempest-VolumesSnapshotNegativeTestJSON-790924345 None] Lock "cinder-26466adc-7ac8-4b3d-b5a9-e8d46116ef49-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:41 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f45f0dab-18c4-43f2-b1b2-538d20adbcb1 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c" returned: 0 in 0.907s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:41 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-f45f0dab-18c4-43f2-b1b2-538d20adbcb1 tempest-VolumesSnapshotTestJSON-832763818 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c is being set with open permissions: ugo+rw Jul 04 00:00:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f45f0dab-18c4-43f2-b1b2-538d20adbcb1 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:41 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c Jul 04 00:00:41 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] Acquiring lock "cinder-062ff848-1f0d-4236-a7cd-28f1001d220a-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] Lock "cinder-062ff848-1f0d-4236-a7cd-28f1001d220a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] Acquiring lock "cinder-quobyte-062ff848-1f0d-4236-a7cd-28f1001d220a" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] Lock "cinder-quobyte-062ff848-1f0d-4236-a7cd-28f1001d220a" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:42 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4826b59-f818-409f-bc47-d66869eaa1ed]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062ff848-1f0d-4236-a7cd-28f1001d220a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:42 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062ff848-1f0d-4236-a7cd-28f1001d220a Jul 04 00:00:42 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:42 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f45f0dab-18c4-43f2-b1b2-538d20adbcb1 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c" returned: 0 in 0.807s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f45f0dab-18c4-43f2-b1b2-538d20adbcb1 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:42 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.info Jul 04 00:00:42 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:43 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062ff848-1f0d-4236-a7cd-28f1001d220a" returned: 0 in 0.914s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062ff848-1f0d-4236-a7cd-28f1001d220a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:43 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f45f0dab-18c4-43f2-b1b2-538d20adbcb1 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.info" returned: 0 in 0.737s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:43 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-f45f0dab-18c4-43f2-b1b2-538d20adbcb1 tempest-VolumesSnapshotTestJSON-832763818 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.info is being set with open permissions: ugo+rw Jul 04 00:00:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f45f0dab-18c4-43f2-b1b2-538d20adbcb1 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:43 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062ff848-1f0d-4236-a7cd-28f1001d220a Jul 04 00:00:43 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:43 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.info Jul 04 00:00:43 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:43 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062ff848-1f0d-4236-a7cd-28f1001d220a" returned: 0 in 0.712s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] Lock "cinder-quobyte-062ff848-1f0d-4236-a7cd-28f1001d220a" released by "delete_volume" :: held 1.684s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:43 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f45f0dab-18c4-43f2-b1b2-538d20adbcb1 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.info" returned: 0 in 0.737s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f45f0dab-18c4-43f2-b1b2-538d20adbcb1 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.156s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.932s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1140464909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969c5517-7171-4970-9920-3fb957df88ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e923800e6545dc9c830a3b1242771b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:36Z,use_quota=True,user_id='8cb18d0084ee41968bd14408feedd16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:00:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Creating volume 969c5517-7171-4970-9920-3fb957df88ed {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:00:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:00:43 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:00:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f45f0dab-18c4-43f2-b1b2-538d20adbcb1 tempest-VolumesSnapshotTestJSON-832763818 None] Create snapshot completed successfully Jul 04 00:00:43 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed 1073741824 Jul 04 00:00:43 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] Created reservations ['0b1e8780-57ae-454d-9734-f775d32c0c17', '57d0307f-cbd7-41c1-a6ef-08dc595ff578', 'f048985a-fad9-44d5-9ecb-845bd757a7e2', '26d868d9-59a3-4695-afdd-23a59eb57ce6'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Flow 'volume_create_manager' (f9e5d7e9-bf3b-4a8b-b223-e494669fea5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d81f3a-8281-43d7-b67c-785e704c8a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d81f3a-8281-43d7-b67c-785e704c8a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1559298387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719863d7-eb6f-470f-ad87-44890ca09f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0e7d6891094b77bd8487116500789a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:44Z,use_quota=True,user_id='b7ca9cd417e44b7f93cc3d83e710085d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1bd983-921f-44ec-8447-9d22ce7ab9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1bd983-921f-44ec-8447-9d22ce7ab9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f130560-3404-4e37-be56-55cba2caa06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f130560-3404-4e37-be56-55cba2caa06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '719863d7-eb6f-470f-ad87-44890ca09f43', 'volume_name': 'volume-719863d7-eb6f-470f-ad87-44890ca09f43', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3378e5d7-74e6-4ab8-9b7c-cb37c7381b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3378e5d7-74e6-4ab8-9b7c-cb37c7381b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf78c50-126a-4386-b30a-95c6b0c9d845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:44 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Volume 719863d7-eb6f-470f-ad87-44890ca09f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-719863d7-eb6f-470f-ad87-44890ca09f43', 'volume_size': 1} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:44 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:00:44 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Flow 'volume_create_manager' (00390073-586a-4003-b1dd-ae6c611e555a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15f0eb2-ff9d-4fb5-acc2-fbe771efe0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15f0eb2-ff9d-4fb5-acc2-fbe771efe0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1198035681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d933c1c2-dccf-4b28-aa12-670caec8c4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0e7d6891094b77bd8487116500789a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:45Z,use_quota=True,user_id='b7ca9cd417e44b7f93cc3d83e710085d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65749b44-c387-42d4-8b62-9a4f65ebfb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65749b44-c387-42d4-8b62-9a4f65ebfb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffdceb4c-37cd-4983-b306-f4cbc597225a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffdceb4c-37cd-4983-b306-f4cbc597225a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd933c1c2-dccf-4b28-aa12-670caec8c4ff', 'volume_name': 'volume-d933c1c2-dccf-4b28-aa12-670caec8c4ff', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97322a21-0e8b-4cfd-b7de-fbf7a8aca127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97322a21-0e8b-4cfd-b7de-fbf7a8aca127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1e52d0-bad1-48e5-bc8a-d0b00d5c5d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:44 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Volume d933c1c2-dccf-4b28-aa12-670caec8c4ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d933c1c2-dccf-4b28-aa12-670caec8c4ff', 'volume_size': 1} Jul 04 00:00:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] Acquiring lock "cinder-062508fe-caeb-40d9-8d60-0c45eef135c2-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Flow 'volume_create_manager' (4c892851-ac00-4a6f-b0c2-5326473b9e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2481687-dd12-4330-b074-af8bd61017c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] Lock "cinder-062508fe-caeb-40d9-8d60-0c45eef135c2-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2481687-dd12-4330-b074-af8bd61017c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1788486603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae26571e-1d62-446f-a584-e4762951d7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f44bf73a1e3a4a51b51a4251f24b75d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=4dcc80a4-2907-43c5-ae4b-dcae207afa9c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:45Z,use_quota=True,user_id='eb5f08484c074c6ab33469a1f0a69322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c97fd8f-3ba1-4b3f-b0cd-691423e5005e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c97fd8f-3ba1-4b3f-b0cd-691423e5005e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83e5522-b093-451a-a310-7a59cdf7dd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83e5522-b093-451a-a310-7a59cdf7dd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ae26571e-1d62-446f-a584-e4762951d7e2', 'volume_name': 'volume-ae26571e-1d62-446f-a584-e4762951d7e2', 'volume_size': 2, 'snapshot_id': '4dcc80a4-2907-43c5-ae4b-dcae207afa9c'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca71a57-4bde-4bf6-8793-f13593f1e084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca71a57-4bde-4bf6-8793-f13593f1e084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb79f4b6-5bd8-4f15-b251-c203aea1edc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:45 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Volume ae26571e-1d62-446f-a584-e4762951d7e2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ae26571e-1d62-446f-a584-e4762951d7e2', 'volume_size': 2, 'snapshot_id': '4dcc80a4-2907-43c5-ae4b-dcae207afa9c'} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] Acquiring lock "cinder-quobyte-062508fe-caeb-40d9-8d60-0c45eef135c2" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Flow 'volume_create_manager' (c0e2b9d3-051c-4ab0-8bab-7ff3dd539cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32043fea-6950-4093-923d-a9f4bb77ddcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:45 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32043fea-6950-4093-923d-a9f4bb77ddcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-211758787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd446b5-0caa-41ea-9661-a18c60fe078a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0e7d6891094b77bd8487116500789a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:45Z,use_quota=True,user_id='b7ca9cd417e44b7f93cc3d83e710085d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e263337-0350-4775-ba16-709860d1f5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e263337-0350-4775-ba16-709860d1f5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b185eadf-26e9-44ab-867f-4cf9d7dbe367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b185eadf-26e9-44ab-867f-4cf9d7dbe367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bd446b5-0caa-41ea-9661-a18c60fe078a', 'volume_name': 'volume-0bd446b5-0caa-41ea-9661-a18c60fe078a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d5d9f2-e029-410f-a0a8-4c7179632c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d5d9f2-e029-410f-a0a8-4c7179632c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86389e6a-b4c6-457e-ad05-8b05d2a2fb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:45 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Volume 0bd446b5-0caa-41ea-9661-a18c60fe078a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bd446b5-0caa-41ea-9661-a18c60fe078a', 'volume_size': 1} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] Lock "cinder-quobyte-062508fe-caeb-40d9-8d60-0c45eef135c2" acquired by "delete_volume" :: waited 0.103s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.262s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:00:45 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] Deleted volume successfully. Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35618c8-35fd-4310-90c7-5315ca852f49]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062508fe-caeb-40d9-8d60-0c45eef135c2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6e97e907-9236-400d-b755-de4c2bd9a069 tempest-VolumesListTestJSON-810921438 None] Lock "cinder-062ff848-1f0d-4236-a7cd-28f1001d220a-delete_volume" released by "delete_volume" :: held 3.441s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:45 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed 1073741824" returned: 0 in 1.679s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:45 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062508fe-caeb-40d9-8d60-0c45eef135c2 Jul 04 00:00:45 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:45 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed Jul 04 00:00:45 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Flow 'volume_create_manager' (ef359a4d-9b60-4fca-868f-81845cea3aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a1af99-9dd9-474e-acd7-d12e0e387435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a1af99-9dd9-474e-acd7-d12e0e387435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-413791514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11f1cf7-0b0b-45fa-a32d-4f977f8963ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0e7d6891094b77bd8487116500789a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:46Z,use_quota=True,user_id='b7ca9cd417e44b7f93cc3d83e710085d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3f6608-7647-481b-8403-0c35e4adb202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3f6608-7647-481b-8403-0c35e4adb202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04647ae0-fec9-48c8-ae91-f906ca960246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04647ae0-fec9-48c8-ae91-f906ca960246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a11f1cf7-0b0b-45fa-a32d-4f977f8963ff', 'volume_name': 'volume-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a5ed10-e5ae-4abe-a707-fe2446eda415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a5ed10-e5ae-4abe-a707-fe2446eda415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c21b034e-1b66-46c8-a270-444938d4bdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:45 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Volume a11f1cf7-0b0b-45fa-a32d-4f977f8963ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff', 'volume_size': 1} Jul 04 00:00:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Flow 'volume_create_manager' (7be4f716-3b50-4e95-866e-453161e1d827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c7d840-1195-4cd8-9de8-b588f793ad0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c7d840-1195-4cd8-9de8-b588f793ad0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-146666233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20297c5a-6c99-40d4-a7b1-2ac28c78c568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0e7d6891094b77bd8487116500789a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:46Z,use_quota=True,user_id='b7ca9cd417e44b7f93cc3d83e710085d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1995012-0abd-4a22-aaa7-398ad1ce2774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1995012-0abd-4a22-aaa7-398ad1ce2774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d898cf0-33bf-4d7d-8f56-e5c45cfd4814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d898cf0-33bf-4d7d-8f56-e5c45cfd4814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20297c5a-6c99-40d4-a7b1-2ac28c78c568', 'volume_name': 'volume-20297c5a-6c99-40d4-a7b1-2ac28c78c568', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe189bf-9167-48ff-9b8e-90105f6df2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe189bf-9167-48ff-9b8e-90105f6df2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e878c0bd-9a5d-484d-abbd-93468470a3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:46 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Volume 20297c5a-6c99-40d4-a7b1-2ac28c78c568: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20297c5a-6c99-40d4-a7b1-2ac28c78c568', 'volume_size': 1} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:46 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed" returned: 0 in 0.782s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] <== create_volume: return (2517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.520s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.223s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1559298387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719863d7-eb6f-470f-ad87-44890ca09f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0e7d6891094b77bd8487116500789a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:44Z,use_quota=True,user_id='b7ca9cd417e44b7f93cc3d83e710085d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Creating volume 719863d7-eb6f-470f-ad87-44890ca09f43 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:00:46 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-719863d7-eb6f-470f-ad87-44890ca09f43 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:46 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062508fe-caeb-40d9-8d60-0c45eef135c2" returned: 0 in 0.935s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062508fe-caeb-40d9-8d60-0c45eef135c2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:46 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-719863d7-eb6f-470f-ad87-44890ca09f43 1073741824 Jul 04 00:00:46 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:46 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062508fe-caeb-40d9-8d60-0c45eef135c2 Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Attempting download of 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 ((None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}])) to volume 969c5517-7171-4970-9920-3fb957df88ed. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 04 00:00:46 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9f7aee-fa2a-43ff-959e-d1a8dd43e4d9]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1h31hset {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:46 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1h31hset Jul 04 00:00:46 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:47 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-062508fe-caeb-40d9-8d60-0c45eef135c2" returned: 0 in 0.732s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] Lock "cinder-quobyte-062508fe-caeb-40d9-8d60-0c45eef135c2" released by "delete_volume" :: held 1.725s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:47 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] Created reservations ['88d83742-9521-4330-914b-0aaeef06c2c6', '750f07be-a85e-4cb4-9571-9624bb08e10d', 'd386d336-b8a8-4819-960b-b6c928986ad5', '1b670a44-1cf3-4883-afac-9d4bccb84313'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:00:47 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1h31hset" returned: 0 in 0.812s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1h31hset {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:47 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-719863d7-eb6f-470f-ad87-44890ca09f43 1073741824" returned: 0 in 0.946s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-719863d7-eb6f-470f-ad87-44890ca09f43 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:47 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:00:47 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:47 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-719863d7-eb6f-470f-ad87-44890ca09f43 Jul 04 00:00:47 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:47 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1h31hset Jul 04 00:00:47 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:48 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1h31hset" returned: 1 in 0.792s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1h31hset' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d5027f-78f2-43ae-805f-17463ff8d2a3]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_pl1b5na2devstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:48 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.727s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:00:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] Deleted volume successfully. Jul 04 00:00:48 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61628794-f4b0-49e6-a9d0-0de947e85c13 tempest-VolumesListTestJSON-810921438 None] Lock "cinder-062508fe-caeb-40d9-8d60-0c45eef135c2-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-719863d7-eb6f-470f-ad87-44890ca09f43" returned: 0 in 0.756s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.306s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1198035681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d933c1c2-dccf-4b28-aa12-670caec8c4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0e7d6891094b77bd8487116500789a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:45Z,use_quota=True,user_id='b7ca9cd417e44b7f93cc3d83e710085d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Creating volume d933c1c2-dccf-4b28-aa12-670caec8c4ff {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:00:48 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d933c1c2-dccf-4b28-aa12-670caec8c4ff 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:48 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d933c1c2-dccf-4b28-aa12-670caec8c4ff 1073741824 Jul 04 00:00:48 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf78c50-126a-4386-b30a-95c6b0c9d845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-719863d7-eb6f-470f-ad87-44890ca09f43', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ccb8aa-58c8-46ea-b772-6955c2542c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:48 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_pl1b5na2devstack@QuobyteHD Jul 04 00:00:48 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:48 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Volume volume-719863d7-eb6f-470f-ad87-44890ca09f43 (719863d7-eb6f-470f-ad87-44890ca09f43): created successfully Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ccb8aa-58c8-46ea-b772-6955c2542c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Flow 'volume_create_manager' (f9e5d7e9-bf3b-4a8b-b223-e494669fea5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-bf9a12fd-7d00-4ab0-b460-d2d1510393ee tempest-CreateVolumesFromImageTest-2142747964 None] Created volume successfully. Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] Acquiring lock "cinder-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] Lock "cinder-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] Acquiring lock "cinder-quobyte-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] Lock "cinder-quobyte-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c600bd9c-e380-4c08-9280-673e59fa237b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:48 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7 Jul 04 00:00:48 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:48 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_pl1b5na2devstack@QuobyteHD" returned: 0 in 0.778s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 was qcow2, converting to raw {{(pid=86676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 04 00:00:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_pl1b5na2devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:49 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_pl1b5na2devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed Jul 04 00:00:49 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:49 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d933c1c2-dccf-4b28-aa12-670caec8c4ff 1073741824" returned: 0 in 0.930s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d933c1c2-dccf-4b28-aa12-670caec8c4ff {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:49 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d933c1c2-dccf-4b28-aa12-670caec8c4ff Jul 04 00:00:49 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:49 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7" returned: 0 in 0.841s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:49 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7 Jul 04 00:00:49 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:50 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d933c1c2-dccf-4b28-aa12-670caec8c4ff" returned: 0 in 0.794s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.641s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-quobyte-4dcc80a4-2907-43c5-ae4b-dcae207afa9c-ae26571e-1d62-446f-a584-e4762951d7e2" by "_create_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1e52d0-bad1-48e5-bc8a-d0b00d5c5d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d933c1c2-dccf-4b28-aa12-670caec8c4ff', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e42d67-d624-41c8-a497-2120e786fbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-4dcc80a4-2907-43c5-ae4b-dcae207afa9c-ae26571e-1d62-446f-a584-e4762951d7e2" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Creating volume ae26571e-1d62-446f-a584-e4762951d7e2 from snapshot 4dcc80a4-2907-43c5-ae4b-dcae207afa9c {{(pid=86676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-quobyte-ae26571e-1d62-446f-a584-e4762951d7e2" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:50 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Volume volume-d933c1c2-dccf-4b28-aa12-670caec8c4ff (d933c1c2-dccf-4b28-aa12-670caec8c4ff): created successfully Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e42d67-d624-41c8-a497-2120e786fbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Flow 'volume_create_manager' (00390073-586a-4003-b1dd-ae6c611e555a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-ae26571e-1d62-446f-a584-e4762951d7e2" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] snapshot: 4dcc80a4-2907-43c5-ae4b-dcae207afa9c, volume: ae26571e-1d62-446f-a584-e4762951d7e2, {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 04 00:00:50 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ae2eb671-5585-49b8-bc07-11a0c24b7d5d tempest-CreateVolumesFromImageTest-2142747964 None] Created volume successfully. Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0a36f4-82f8-4371-a9b4-d49a7c1014d0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:50 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7" returned: 0 in 0.689s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] Lock "cinder-quobyte-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7" released by "delete_volume" :: held 1.578s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] Created reservations ['74a88194-6401-4aa8-85c7-0b959a64c460', 'db40e738-fbcd-48b1-a9e6-2ed150a76b66', 'f0d8d511-164e-4871-b525-8e12dacb0986', '65df92b2-ad05-4216-a2b5-1be3da2ee1da'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:00:50 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c Jul 04 00:00:50 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:50 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:00:50 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:51 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c" returned: 0 in 0.865s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:00:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 04 00:00:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 04 00:00:51 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15bab8d-40a3-4eed-88f5-9799dc023257]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:51 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.803s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:51 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 Jul 04 00:00:51 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:51 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:00:51 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] Deleted volume successfully. Jul 04 00:00:51 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_pl1b5na2devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed" returned: 0 in 2.274s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:51 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_pl1b5na2devstack@QuobyteHD, size 112.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 04 00:00:51 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Converted 112.00 MB image at 49.23 MB/s Jul 04 00:00:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7536a55c-86a4-4f16-b337-3e04ddbed25c tempest-VolumesListTestJSON-810921438 None] Lock "cinder-7f9e1eca-7545-4aa1-bb28-26fa3996f6c7-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:51 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed 1G Jul 04 00:00:51 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:52 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577" returned: 0 in 0.986s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:52 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:52 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Path /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ae26571e-1d62-446f-a584-e4762951d7e2 not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 04 00:00:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ae26571e-1d62-446f-a584-e4762951d7e2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed 1G" returned: 0 in 0.861s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:52 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ae26571e-1d62-446f-a584-e4762951d7e2 Jul 04 00:00:52 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:52 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[686a3ea8-939e-4865-955c-fce2ada6395c]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:52 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed Jul 04 00:00:52 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:53 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed" returned: 0 in 0.858s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:53 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed Jul 04 00:00:53 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:55 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed" returned: 1 in 2.385s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:00:55 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Downloaded image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 ((None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}])) to volume 969c5517-7171-4970-9920-3fb957df88ed successfully. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 04 00:00:55 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Temporary image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 for user 8cb18d0084ee41968bd14408feedd16e is deleted. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 04 00:00:55 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Marking volume 969c5517-7171-4970-9920-3fb957df88ed as bootable. {{(pid=86676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 04 00:00:55 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Copying metadata from image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 to 969c5517-7171-4970-9920-3fb957df88ed. {{(pid=86676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 04 00:00:55 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Creating volume glance metadata for volume 969c5517-7171-4970-9920-3fb957df88ed backed by image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 04 00:00:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9198d83a-87b4-4e7a-987d-2467b44b9f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-969c5517-7171-4970-9920-3fb957df88ed', 'volume_size': 1, 'image_id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47a94a0f3bea4708b842e25ca5b22b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df337d9e-31d2-4fc3-8d84-35a16cbb0411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:55 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Volume volume-969c5517-7171-4970-9920-3fb957df88ed (969c5517-7171-4970-9920-3fb957df88ed): created successfully Jul 04 00:00:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df337d9e-31d2-4fc3-8d84-35a16cbb0411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Flow 'volume_create_manager' (84d20866-4529-4bf7-98f8-5636de6b06a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ee0d5064-a578-4b62-93c8-2b66725dbb40 tempest-VolumesImageMetadata-552189365 None] Created volume successfully. Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Flow 'volume_create_manager' (c296fff1-0aec-42cc-a41c-a8c912958711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99953f6a-3419-4d0b-9482-a884be892bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99953f6a-3419-4d0b-9482-a884be892bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-101781343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62363fd-8cb8-49f0-afd6-628ab1f13c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94da35aae8d3418db7d328922882b38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:57Z,use_quota=True,user_id='9bb7603a558c49e1a11e5bd19aabe64f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703a5f04-d99d-4f0b-b5b0-23dae199a5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703a5f04-d99d-4f0b-b5b0-23dae199a5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ae329e-7976-4e66-b1b0-a30d18ce04b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ae329e-7976-4e66-b1b0-a30d18ce04b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a62363fd-8cb8-49f0-afd6-628ab1f13c73', 'volume_name': 'volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb60b5b5-1be0-4ada-bee4-f69300a6b385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb60b5b5-1be0-4ada-bee4-f69300a6b385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ba2799-26ae-46d6-9d0e-42dbd6261bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:57 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Volume a62363fd-8cb8-49f0-afd6-628ab1f13c73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73', 'volume_size': 1} Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] Acquiring lock "cinder-969c5517-7171-4970-9920-3fb957df88ed-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] Lock "cinder-969c5517-7171-4970-9920-3fb957df88ed-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] Acquiring lock "cinder-quobyte-969c5517-7171-4970-9920-3fb957df88ed" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] Lock "cinder-quobyte-969c5517-7171-4970-9920-3fb957df88ed" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96ea9f1-9757-4747-bbca-d0c594daf7f8]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:57 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ae26571e-1d62-446f-a584-e4762951d7e2" returned: 0 in 5.820s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf211e66-af01-49c0-aff7-0b51b38f209b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:00:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:57 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed Jul 04 00:00:57 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:58 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 Jul 04 00:00:58 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:58 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed" returned: 0 in 0.783s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:58 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed Jul 04 00:00:58 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:58 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577" returned: 0 in 0.991s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:58 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ae26571e-1d62-446f-a584-e4762951d7e2 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 04 00:00:58 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Converted 1024.00 MB image at 175.92 MB/s Jul 04 00:00:58 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ae26571e-1d62-446f-a584-e4762951d7e2 is being set with open permissions: ugo+rw Jul 04 00:00:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ae26571e-1d62-446f-a584-e4762951d7e2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:58 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ae26571e-1d62-446f-a584-e4762951d7e2 Jul 04 00:00:58 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:59 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed" returned: 1 in 0.784s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:59 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed Jul 04 00:00:59 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:59 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ae26571e-1d62-446f-a584-e4762951d7e2" returned: 0 in 0.677s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-ae26571e-1d62-446f-a584-e4762951d7e2" released by "_copy_volume_from_snapshot" :: held 9.466s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-4dcc80a4-2907-43c5-ae4b-dcae207afa9c-ae26571e-1d62-446f-a584-e4762951d7e2" released by "_create_volume_from_snapshot" :: held 9.540s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.591s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.112s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-211758787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd446b5-0caa-41ea-9661-a18c60fe078a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0e7d6891094b77bd8487116500789a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:45Z,use_quota=True,user_id='b7ca9cd417e44b7f93cc3d83e710085d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Creating volume 0bd446b5-0caa-41ea-9661-a18c60fe078a {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:00:59 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0bd446b5-0caa-41ea-9661-a18c60fe078a 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:00:59 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0bd446b5-0caa-41ea-9661-a18c60fe078a 1073741824 Jul 04 00:00:59 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb79f4b6-5bd8-4f15-b251-c203aea1edc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae26571e-1d62-446f-a584-e4762951d7e2', 'volume_size': 2, 'snapshot_id': '4dcc80a4-2907-43c5-ae4b-dcae207afa9c'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193d5530-8d96-4630-95f6-72f34d93a9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:00:59 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Volume volume-ae26571e-1d62-446f-a584-e4762951d7e2 (ae26571e-1d62-446f-a584-e4762951d7e2): created successfully Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193d5530-8d96-4630-95f6-72f34d93a9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:00:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Flow 'volume_create_manager' (4c892851-ac00-4a6f-b0c2-5326473b9e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:00:59 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-793a4f37-7c0e-402a-b5a3-45358156a188 tempest-VolumesSnapshotTestJSON-832763818 None] Created volume successfully. Jul 04 00:01:00 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-969c5517-7171-4970-9920-3fb957df88ed" returned: 0 in 0.719s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] Lock "cinder-quobyte-969c5517-7171-4970-9920-3fb957df88ed" released by "delete_volume" :: held 2.361s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:00 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] Created reservations ['0d6f4f16-d080-45f3-808e-b6ca399f70e5', '0375ed09-6221-43ab-a993-0e7c944be27c', '07954d18-e8f3-43b1-b844-66f7565d15dc', 'e58d94f5-012e-4385-bd3b-1fd285f9cf18'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:00 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:01:00 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:00 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0bd446b5-0caa-41ea-9661-a18c60fe078a 1073741824" returned: 0 in 0.943s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0bd446b5-0caa-41ea-9661-a18c60fe078a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:00 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0bd446b5-0caa-41ea-9661-a18c60fe078a Jul 04 00:01:00 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-ae26571e-1d62-446f-a584-e4762951d7e2-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-ae26571e-1d62-446f-a584-e4762951d7e2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-quobyte-ae26571e-1d62-446f-a584-e4762951d7e2" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-ae26571e-1d62-446f-a584-e4762951d7e2" acquired by "delete_volume" :: waited 0.032s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d51ec50-bb86-4394-a3d4-9e02b9dc27fd]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ae26571e-1d62-446f-a584-e4762951d7e2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:01 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.813s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:01:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] Deleted volume successfully. Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aaf2ec67-c203-4a8e-803f-e8ef28546d20 tempest-VolumesImageMetadata-552189365 None] Lock "cinder-969c5517-7171-4970-9920-3fb957df88ed-delete_volume" released by "delete_volume" :: held 3.451s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:01 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ae26571e-1d62-446f-a584-e4762951d7e2 Jul 04 00:01:01 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:01 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0bd446b5-0caa-41ea-9661-a18c60fe078a" returned: 0 in 0.783s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.453s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-413791514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11f1cf7-0b0b-45fa-a32d-4f977f8963ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0e7d6891094b77bd8487116500789a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:46Z,use_quota=True,user_id='b7ca9cd417e44b7f93cc3d83e710085d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Creating volume a11f1cf7-0b0b-45fa-a32d-4f977f8963ff {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:01:01 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86389e6a-b4c6-457e-ad05-8b05d2a2fb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd446b5-0caa-41ea-9661-a18c60fe078a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:01 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff 1073741824 Jul 04 00:01:01 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b2262a-b42f-4f0c-a82f-9a4adaf0779b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:01 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Volume volume-0bd446b5-0caa-41ea-9661-a18c60fe078a (0bd446b5-0caa-41ea-9661-a18c60fe078a): created successfully Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b2262a-b42f-4f0c-a82f-9a4adaf0779b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Flow 'volume_create_manager' (c0e2b9d3-051c-4ab0-8bab-7ff3dd539cd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2398c962-af78-414e-a25d-3ef1513c5ea8 tempest-CreateVolumesFromImageTest-2142747964 None] Created volume successfully. Jul 04 00:01:02 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ae26571e-1d62-446f-a584-e4762951d7e2" returned: 0 in 0.957s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ae26571e-1d62-446f-a584-e4762951d7e2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:02 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ae26571e-1d62-446f-a584-e4762951d7e2 Jul 04 00:01:02 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff 1073741824" returned: 0 in 1.050s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:02 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:02 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff Jul 04 00:01:02 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:02 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ae26571e-1d62-446f-a584-e4762951d7e2" returned: 0 in 0.783s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-ae26571e-1d62-446f-a584-e4762951d7e2" released by "delete_volume" :: held 1.792s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:02 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] Created reservations ['c4e19110-5e73-427b-b094-dd0efb2a3637', '01fde437-77da-4ba9-b452-5cf28df1f6ea', '2e0313cf-e330-4ac1-a5b5-4a482e8b0210', '1aa52136-0625-4e21-a95b-6a8bf5924b7c'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:03 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:01:03 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-4dcc80a4-2907-43c5-ae4b-dcae207afa9c-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:03 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-4dcc80a4-2907-43c5-ae4b-dcae207afa9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-quobyte-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff" returned: 0 in 0.819s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.963s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-146666233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20297c5a-6c99-40d4-a7b1-2ac28c78c568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0e7d6891094b77bd8487116500789a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:46Z,use_quota=True,user_id='b7ca9cd417e44b7f93cc3d83e710085d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Creating volume 20297c5a-6c99-40d4-a7b1-2ac28c78c568 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:01:03 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-20297c5a-6c99-40d4-a7b1-2ac28c78c568 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577" acquired by "delete_snapshot" :: waited 0.075s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-quobyte-4dcc80a4-2907-43c5-ae4b-dcae207afa9c" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:03 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-20297c5a-6c99-40d4-a7b1-2ac28c78c568 1073741824 Jul 04 00:01:03 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c21b034e-1b66-46c8-a270-444938d4bdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebcf2c6a-9a1f-400b-9321-64f95caae46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-4dcc80a4-2907-43c5-ae4b-dcae207afa9c" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] Deleting offline snapshot 4dcc80a4-2907-43c5-ae4b-dcae207afa9c of volume 8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] snapshot_file for this snap is: volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:01:03 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Volume volume-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff (a11f1cf7-0b0b-45fa-a32d-4f977f8963ff): created successfully Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebcf2c6a-9a1f-400b-9321-64f95caae46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Flow 'volume_create_manager' (ef359a4d-9b60-4fca-868f-81845cea3aba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc23723-cc0c-42ea-93ba-a719ef244a27]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:03 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-48ab7efe-c5f9-4383-8af0-7dbeeacf9ef1 tempest-CreateVolumesFromImageTest-2142747964 None] Created volume successfully. Jul 04 00:01:03 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c Jul 04 00:01:03 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:03 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.793s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:01:03 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] Deleted volume successfully. Jul 04 00:01:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ee1fda19-e95a-4d73-a7bc-7210af7cdd4e tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-ae26571e-1d62-446f-a584-e4762951d7e2-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:04 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-20297c5a-6c99-40d4-a7b1-2ac28c78c568 1073741824" returned: 0 in 1.027s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-20297c5a-6c99-40d4-a7b1-2ac28c78c568 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:04 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c" returned: 0 in 0.947s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:01:04 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-20297c5a-6c99-40d4-a7b1-2ac28c78c568 Jul 04 00:01:04 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:04 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde709f9-4d42-4688-8487-b9776b2b9ad4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:04 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 Jul 04 00:01:04 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:05 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-20297c5a-6c99-40d4-a7b1-2ac28c78c568" returned: 0 in 0.860s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.831s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-101781343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62363fd-8cb8-49f0-afd6-628ab1f13c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94da35aae8d3418db7d328922882b38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:57Z,use_quota=True,user_id='9bb7603a558c49e1a11e5bd19aabe64f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Creating volume a62363fd-8cb8-49f0-afd6-628ab1f13c73 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:01:05 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e878c0bd-9a5d-484d-abbd-93468470a3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20297c5a-6c99-40d4-a7b1-2ac28c78c568', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:05 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73 1073741824 Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac37692-08ba-4ac5-ae57-232394bfe0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:05 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:05 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Volume volume-20297c5a-6c99-40d4-a7b1-2ac28c78c568 (20297c5a-6c99-40d4-a7b1-2ac28c78c568): created successfully Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac37692-08ba-4ac5-ae57-232394bfe0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Flow 'volume_create_manager' (7be4f716-3b50-4e95-866e-453161e1d827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:05 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-75a6e728-b218-4a8c-a136-6c62a888dd42 tempest-CreateVolumesFromImageTest-2142747964 None] Created volume successfully. Jul 04 00:01:05 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577" returned: 0 in 0.883s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:05 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c Jul 04 00:01:05 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "cinder-20297c5a-6c99-40d4-a7b1-2ac28c78c568-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-20297c5a-6c99-40d4-a7b1-2ac28c78c568-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "cinder-quobyte-20297c5a-6c99-40d4-a7b1-2ac28c78c568" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-quobyte-20297c5a-6c99-40d4-a7b1-2ac28c78c568" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4ff356-a48f-42e3-bd24-e0d0450dd258]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-20297c5a-6c99-40d4-a7b1-2ac28c78c568 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:06 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-20297c5a-6c99-40d4-a7b1-2ac28c78c568 Jul 04 00:01:06 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:06 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c" returned: 0 in 0.934s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:06 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c Jul 04 00:01:06 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:06 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73 1073741824" returned: 0 in 1.129s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:06 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73 Jul 04 00:01:06 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:06 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-20297c5a-6c99-40d4-a7b1-2ac28c78c568" returned: 0 in 0.885s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-20297c5a-6c99-40d4-a7b1-2ac28c78c568 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:06 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-20297c5a-6c99-40d4-a7b1-2ac28c78c568 Jul 04 00:01:06 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:07 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577.4dcc80a4-2907-43c5-ae4b-dcae207afa9c" returned: 0 in 0.795s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-4dcc80a4-2907-43c5-ae4b-dcae207afa9c" released by "_delete_snapshot" :: held 3.753s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577" released by "delete_snapshot" :: held 3.810s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] Created reservations ['dc7e9bb0-df91-4034-adeb-e11a8579802b', '0c978dac-376d-4c00-9f3d-6f6a32262f74', '43f93c53-6766-487a-b42d-85d249a2e76e', 'b038aa05-1f7e-4702-9d5e-f399f85ccacb'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:07 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] Delete snapshot completed successfully. Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8af5b305-9591-4814-a2da-4013b7d4da5c tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-4dcc80a4-2907-43c5-ae4b-dcae207afa9c-delete_snapshot" released by "delete_snapshot" :: held 4.053s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:07 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73" returned: 0 in 0.872s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ba2799-26ae-46d6-9d0e-42dbd6261bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90fe7b96-d86d-4cdf-a73b-3ee17155be95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:07 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Volume volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73 (a62363fd-8cb8-49f0-afd6-628ab1f13c73): created successfully Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90fe7b96-d86d-4cdf-a73b-3ee17155be95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Flow 'volume_create_manager' (c296fff1-0aec-42cc-a41c-a8c912958711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:07 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-07e3fd10-9710-41df-9846-9eabf73fc40c tempest-VolumesSnapshotListTestJSON-1668822991 None] Created volume successfully. Jul 04 00:01:07 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-20297c5a-6c99-40d4-a7b1-2ac28c78c568" returned: 0 in 0.793s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-quobyte-20297c5a-6c99-40d4-a7b1-2ac28c78c568" released by "delete_volume" :: held 1.732s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] Created reservations ['f326cb79-4ad1-42bb-87b2-93976fafea0d', '24da9b3b-bb06-4571-8ba0-c3e91c5b3768', '8e650811-9a12-47a5-97da-a3051dd923d3', 'e56034dc-422c-4ee5-8e61-8889b1a519cf'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Flow 'volume_create_manager' (da5c6935-b41a-4144-8165-35a59929fa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b976a256-a384-452d-bcfc-a5b0a23847ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-quobyte-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b976a256-a384-452d-bcfc-a5b0a23847ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-893819055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51db6b09-2f55-4798-9009-4210699d60fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8bcd0e2b134119b1f659465aa20641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:08Z,use_quota=True,user_id='4d079cbf15874ed2a0ccaaa3d285b1ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db67f5d-bdde-43bb-97d2-8f64ebbf219f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db67f5d-bdde-43bb-97d2-8f64ebbf219f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac439743-c343-4dac-a8f0-7b2e89f952a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac439743-c343-4dac-a8f0-7b2e89f952a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51db6b09-2f55-4798-9009-4210699d60fa', 'volume_name': 'volume-51db6b09-2f55-4798-9009-4210699d60fa', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a17e26-0f1f-40da-8818-7d9e9aa90f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a17e26-0f1f-40da-8818-7d9e9aa90f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f482f99-104b-432f-9de0-f8fa2888d2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:07 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Volume 51db6b09-2f55-4798-9009-4210699d60fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51db6b09-2f55-4798-9009-4210699d60fa', 'volume_size': 1} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-893819055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51db6b09-2f55-4798-9009-4210699d60fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8bcd0e2b134119b1f659465aa20641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:08Z,use_quota=True,user_id='4d079cbf15874ed2a0ccaaa3d285b1ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Creating volume 51db6b09-2f55-4798-9009-4210699d60fa {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:01:07 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577" acquired by "delete_volume" :: waited 0.086s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:07 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa 1073741824 Jul 04 00:01:07 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:08 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[701b1c87-35ab-4ed3-b651-ecb0e404f5d0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:08 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:01:08 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "cinder-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ccc6271c-089a-4094-b51d-9478a0292763 tempest-VolumesSnapshotListTestJSON-1668822991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:08 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 Jul 04 00:01:08 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "cinder-quobyte-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-quobyte-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:08 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2648cc4-5c78-47b3-b202-e530794145d5]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:08 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff Jul 04 00:01:08 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:08 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.871s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:08 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:01:08 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] Deleted volume successfully. Jul 04 00:01:08 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577" returned: 0 in 0.965s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9fb9c509-e7e1-43e7-8a17-f7177f02e346 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-20297c5a-6c99-40d4-a7b1-2ac28c78c568-delete_volume" released by "delete_volume" :: held 3.148s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:09 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577 Jul 04 00:01:09 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:09 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa 1073741824" returned: 0 in 1.083s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:09 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa Jul 04 00:01:09 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:09 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff" returned: 0 in 0.894s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:09 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff Jul 04 00:01:09 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:09 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577" returned: 0 in 0.776s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577" released by "delete_volume" :: held 1.822s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:09 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa" returned: 0 in 0.758s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ccc6271c-089a-4094-b51d-9478a0292763 tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.652s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] Created reservations ['e6a57827-11f9-4f33-9126-4343b67a02b9', 'f847457e-a7d7-4fcd-856b-1db88f009503', '712d7dab-7da9-4e6a-b927-63cc7be63056', 'eee5ed05-cc65-49b3-9f3b-19035c753ce0'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ccc6271c-089a-4094-b51d-9478a0292763 tempest-VolumesSnapshotListTestJSON-1668822991 None] Creating offline snapshot ecd341f3-141e-4afc-8285-891e42b78984 of volume a62363fd-8cb8-49f0-afd6-628ab1f13c73 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f482f99-104b-432f-9de0-f8fa2888d2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51db6b09-2f55-4798-9009-4210699d60fa', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae5f04f-393e-4ea2-8cc0-7618b674f91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea3d3d9-8317-491b-ab05-b6ed3c3e1628]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ccc6271c-089a-4094-b51d-9478a0292763 tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:09 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Volume volume-51db6b09-2f55-4798-9009-4210699d60fa (51db6b09-2f55-4798-9009-4210699d60fa): created successfully Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae5f04f-393e-4ea2-8cc0-7618b674f91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Flow 'volume_create_manager' (da5c6935-b41a-4144-8165-35a59929fa15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-50bcd4bc-7981-4e34-b243-e172272c45b9 tempest-VolumesDeleteCascade-1265150594 None] Created volume successfully. Jul 04 00:01:09 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff" returned: 0 in 0.750s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-quobyte-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff" released by "delete_volume" :: held 1.709s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:10 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:01:10 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:10 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73 Jul 04 00:01:10 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] Created reservations ['7109a932-6e48-402a-b0a1-47970e850cd2', '11d9729a-72c5-4855-a216-76c8521caa53', 'c594d933-b6c4-409f-a995-f5ffc746f110', '656ee1f4-af6e-46e5-b1bd-dada6c3b9a3c'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:10 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:01:10 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "cinder-0bd446b5-0caa-41ea-9661-a18c60fe078a-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-0bd446b5-0caa-41ea-9661-a18c60fe078a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "cinder-quobyte-0bd446b5-0caa-41ea-9661-a18c60fe078a" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-quobyte-0bd446b5-0caa-41ea-9661-a18c60fe078a" acquired by "delete_volume" :: waited 0.033s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e964780b-df6f-46d0-acd2-878a45aac120]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0bd446b5-0caa-41ea-9661-a18c60fe078a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:10 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ccc6271c-089a-4094-b51d-9478a0292763 tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73" returned: 0 in 0.895s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ccc6271c-089a-4094-b51d-9478a0292763 tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:10 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 1G Jul 04 00:01:10 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:10 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0bd446b5-0caa-41ea-9661-a18c60fe078a Jul 04 00:01:10 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:10 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.837s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:01:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] Deleted volume successfully. Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f1f27b7d-88aa-44ff-99ae-9ba788d33d2b tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-8b0bc1bb-0efc-4e97-8bb0-0c9bd9f3a577-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:10 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.764s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:01:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] Deleted volume successfully. Jul 04 00:01:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a5883aee-3427-4aa7-96c5-c80b608efcb9 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-a11f1cf7-0b0b-45fa-a32d-4f977f8963ff-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b7334930-c0b6-4c28-b6b5-bdedd164140f tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:11 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0bd446b5-0caa-41ea-9661-a18c60fe078a" returned: 0 in 0.971s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0bd446b5-0caa-41ea-9661-a18c60fe078a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:11 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0bd446b5-0caa-41ea-9661-a18c60fe078a Jul 04 00:01:11 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:11 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:01:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Flow 'volume_create_manager' (574e6b74-870c-48e3-9714-476da6f8c459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:11 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c8f5d3-6c10-45e2-b4c5-a246e6a41189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ccc6271c-089a-4094-b51d-9478a0292763 tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 1G" returned: 0 in 0.981s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ccc6271c-089a-4094-b51d-9478a0292763 tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c8f5d3-6c10-45e2-b4c5-a246e6a41189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-588688389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b137cc-893e-4ee8-bd46-bf0289fb170a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f44bf73a1e3a4a51b51a4251f24b75d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:12Z,use_quota=True,user_id='eb5f08484c074c6ab33469a1f0a69322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:11 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 Jul 04 00:01:11 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace9662f-333a-4c3a-9add-56896c46015e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace9662f-333a-4c3a-9add-56896c46015e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12441c2a-4565-465f-8f25-35034c84ac22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12441c2a-4565-465f-8f25-35034c84ac22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8b137cc-893e-4ee8-bd46-bf0289fb170a', 'volume_name': 'volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a1fb2e-67d0-4f0d-8c0f-429f80cd0217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a1fb2e-67d0-4f0d-8c0f-429f80cd0217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432e02eb-f6d3-4f20-a60d-85a94dc70e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:11 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Volume b8b137cc-893e-4ee8-bd46-bf0289fb170a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a', 'volume_size': 1} Jul 04 00:01:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:12 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0bd446b5-0caa-41ea-9661-a18c60fe078a" returned: 0 in 0.664s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-quobyte-0bd446b5-0caa-41ea-9661-a18c60fe078a" released by "delete_volume" :: held 1.678s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:12 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] Created reservations ['a25ee91c-0f64-40cc-9eb4-b6b780707bfd', '71991a5c-08a4-4602-b986-b6a0320202b6', '890ee6d9-5102-438c-aa57-fcb64304186f', '7f14e3e2-719d-4671-8d9a-389e510346f7'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:12 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:01:12 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:12 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ccc6271c-089a-4094-b51d-9478a0292763 tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984" returned: 0 in 0.721s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:12 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-ccc6271c-089a-4094-b51d-9478a0292763 tempest-VolumesSnapshotListTestJSON-1668822991 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 is being set with open permissions: ugo+rw Jul 04 00:01:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ccc6271c-089a-4094-b51d-9478a0292763 tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:12 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 Jul 04 00:01:12 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "cinder-d933c1c2-dccf-4b28-aa12-670caec8c4ff-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-d933c1c2-dccf-4b28-aa12-670caec8c4ff-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "cinder-quobyte-d933c1c2-dccf-4b28-aa12-670caec8c4ff" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-quobyte-d933c1c2-dccf-4b28-aa12-670caec8c4ff" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:12 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50cd342-8316-46c6-99b4-dd0c2d131c79]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d933c1c2-dccf-4b28-aa12-670caec8c4ff {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:13 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d933c1c2-dccf-4b28-aa12-670caec8c4ff Jul 04 00:01:13 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:13 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.671s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:13 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:01:13 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] Deleted volume successfully. Jul 04 00:01:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4032e51f-6ea7-425c-9bc9-c153c3c22135 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-0bd446b5-0caa-41ea-9661-a18c60fe078a-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:13 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ccc6271c-089a-4094-b51d-9478a0292763 tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984" returned: 0 in 0.704s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ccc6271c-089a-4094-b51d-9478a0292763 tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:13 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.info Jul 04 00:01:13 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:13 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d933c1c2-dccf-4b28-aa12-670caec8c4ff" returned: 0 in 0.795s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d933c1c2-dccf-4b28-aa12-670caec8c4ff {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:13 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d933c1c2-dccf-4b28-aa12-670caec8c4ff Jul 04 00:01:13 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:13 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ccc6271c-089a-4094-b51d-9478a0292763 tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.info" returned: 0 in 0.693s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:13 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-ccc6271c-089a-4094-b51d-9478a0292763 tempest-VolumesSnapshotListTestJSON-1668822991 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.info is being set with open permissions: ugo+rw Jul 04 00:01:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ccc6271c-089a-4094-b51d-9478a0292763 tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:13 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.info Jul 04 00:01:13 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:14 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d933c1c2-dccf-4b28-aa12-670caec8c4ff" returned: 0 in 0.664s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-quobyte-d933c1c2-dccf-4b28-aa12-670caec8c4ff" released by "delete_volume" :: held 1.516s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:14 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] Created reservations ['2e5fab28-52e2-4a8b-9111-d9165eaf9a9f', '7a48189c-ed86-4ddc-90a8-08bb1d8175fc', '04a7e1b2-3f47-490b-9d2a-6415d419715e', '32c058c7-a232-4d17-afa8-3db6d84d7003'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:14 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:01:14 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:14 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ccc6271c-089a-4094-b51d-9478a0292763 tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.info" returned: 0 in 0.693s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ccc6271c-089a-4094-b51d-9478a0292763 tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.803s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b7334930-c0b6-4c28-b6b5-bdedd164140f tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.382s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b7334930-c0b6-4c28-b6b5-bdedd164140f tempest-VolumesDeleteCascade-1265150594 None] Creating offline snapshot e8280d05-2ee6-4826-b5ec-476b00f65862 of volume 51db6b09-2f55-4798-9009-4210699d60fa {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:01:14 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9195932a-3f2d-48c3-8663-c499c3275050]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7334930-c0b6-4c28-b6b5-bdedd164140f tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:14 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ccc6271c-089a-4094-b51d-9478a0292763 tempest-VolumesSnapshotListTestJSON-1668822991 None] Create snapshot completed successfully Jul 04 00:01:14 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa Jul 04 00:01:14 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "cinder-719863d7-eb6f-470f-ad87-44890ca09f43-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-719863d7-eb6f-470f-ad87-44890ca09f43-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "cinder-quobyte-719863d7-eb6f-470f-ad87-44890ca09f43" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-quobyte-719863d7-eb6f-470f-ad87-44890ca09f43" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:15 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[984b1964-584b-48fa-b36a-c33d6978bf3f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-719863d7-eb6f-470f-ad87-44890ca09f43 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:15 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.696s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:15 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:01:15 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] Deleted volume successfully. Jul 04 00:01:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-99c90179-1646-4190-922c-603286569cf7 tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-d933c1c2-dccf-4b28-aa12-670caec8c4ff-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:15 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-719863d7-eb6f-470f-ad87-44890ca09f43 Jul 04 00:01:15 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:15 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7334930-c0b6-4c28-b6b5-bdedd164140f tempest-VolumesDeleteCascade-1265150594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa" returned: 0 in 0.864s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7334930-c0b6-4c28-b6b5-bdedd164140f tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:15 devstack sudo[97576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 1G Jul 04 00:01:15 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7d7c400e-9481-4cea-a8ba-bff56a04f30d tempest-VolumesSnapshotListTestJSON-1668822991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:16 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-719863d7-eb6f-470f-ad87-44890ca09f43" returned: 0 in 0.820s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-719863d7-eb6f-470f-ad87-44890ca09f43 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:16 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-719863d7-eb6f-470f-ad87-44890ca09f43 Jul 04 00:01:16 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:16 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7334930-c0b6-4c28-b6b5-bdedd164140f tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 1G" returned: 0 in 0.855s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7334930-c0b6-4c28-b6b5-bdedd164140f tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51db6b09-2f55-4798-9009-4210699d60fa -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:16 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51db6b09-2f55-4798-9009-4210699d60fa -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 Jul 04 00:01:16 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:16 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-719863d7-eb6f-470f-ad87-44890ca09f43" returned: 0 in 0.668s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-quobyte-719863d7-eb6f-470f-ad87-44890ca09f43" released by "delete_volume" :: held 1.535s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:16 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] Created reservations ['f830df04-5376-4103-9193-794cd319d3cb', '2768362c-d882-476f-9cea-3fe6e5b66d02', 'c4de0baa-ac09-485a-8049-333f7e7a9735', 'a367241a-1d79-4ff5-97c5-302c05379054'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:16 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:01:16 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:17 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7334930-c0b6-4c28-b6b5-bdedd164140f tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51db6b09-2f55-4798-9009-4210699d60fa -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862" returned: 0 in 0.737s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:17 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-b7334930-c0b6-4c28-b6b5-bdedd164140f tempest-VolumesDeleteCascade-1265150594 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 is being set with open permissions: ugo+rw Jul 04 00:01:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7334930-c0b6-4c28-b6b5-bdedd164140f tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:17 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 Jul 04 00:01:17 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:17 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.718s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:17 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:01:17 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] Deleted volume successfully. Jul 04 00:01:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a83c0e00-582c-408e-a410-c0cc040ae4bd tempest-CreateVolumesFromImageTest-2142747964 None] Lock "cinder-719863d7-eb6f-470f-ad87-44890ca09f43-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:17 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7334930-c0b6-4c28-b6b5-bdedd164140f tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862" returned: 0 in 0.659s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7334930-c0b6-4c28-b6b5-bdedd164140f tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:17 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.info Jul 04 00:01:17 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:18 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7334930-c0b6-4c28-b6b5-bdedd164140f tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.info" returned: 0 in 0.774s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:18 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-b7334930-c0b6-4c28-b6b5-bdedd164140f tempest-VolumesDeleteCascade-1265150594 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.info is being set with open permissions: ugo+rw Jul 04 00:01:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7334930-c0b6-4c28-b6b5-bdedd164140f tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:18 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.info Jul 04 00:01:18 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:19 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7334930-c0b6-4c28-b6b5-bdedd164140f tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.info" returned: 0 in 0.747s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b7334930-c0b6-4c28-b6b5-bdedd164140f tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.764s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.581s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-588688389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b137cc-893e-4ee8-bd46-bf0289fb170a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f44bf73a1e3a4a51b51a4251f24b75d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:12Z,use_quota=True,user_id='eb5f08484c074c6ab33469a1f0a69322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:01:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Creating volume b8b137cc-893e-4ee8-bd46-bf0289fb170a {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:01:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:01:19 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:01:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:19 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a 1073741824 Jul 04 00:01:19 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:19 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b7334930-c0b6-4c28-b6b5-bdedd164140f tempest-VolumesDeleteCascade-1265150594 None] Create snapshot completed successfully Jul 04 00:01:20 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a 1073741824" returned: 0 in 0.875s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:20 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a Jul 04 00:01:20 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:20 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:01:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Flow 'volume_create_manager' (e3488ccd-9b73-497b-9a4a-b61305f8d279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994a421e-ab3e-4c79-b997-66a1f6c45bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994a421e-ab3e-4c79-b997-66a1f6c45bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1062465567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f994995-e00e-481f-b97a-d83c653bf246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='920613d8d84e401bb55ceb100d22083d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:20Z,use_quota=True,user_id='e924d20df0744cb1bbe2b96e6e322b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a426a60-0027-4d6d-91cd-960982d67bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a426a60-0027-4d6d-91cd-960982d67bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40625f37-d66d-4004-a098-8c76bcec3522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40625f37-d66d-4004-a098-8c76bcec3522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f994995-e00e-481f-b97a-d83c653bf246', 'volume_name': 'volume-6f994995-e00e-481f-b97a-d83c653bf246', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cef7543-fcaa-4f40-8de9-ecbcdc41f02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cef7543-fcaa-4f40-8de9-ecbcdc41f02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b186c2-be79-43e9-9dad-21ec3ceef113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:20 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Volume 6f994995-e00e-481f-b97a-d83c653bf246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f994995-e00e-481f-b97a-d83c653bf246', 'volume_size': 1} Jul 04 00:01:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fd2838ac-037a-44b8-8b2d-429ea7465cf4 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:21 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a" returned: 0 in 0.714s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:01:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7d7c400e-9481-4cea-a8ba-bff56a04f30d tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.438s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7d7c400e-9481-4cea-a8ba-bff56a04f30d tempest-VolumesSnapshotListTestJSON-1668822991 None] Creating offline snapshot 24e78a0a-830a-4e24-a3d9-697c292bf3f9 of volume a62363fd-8cb8-49f0-afd6-628ab1f13c73 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:01:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432e02eb-f6d3-4f20-a60d-85a94dc70e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11e63c6-f4cf-4756-ac73-d678bf88dbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:21 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a235ea3-2a1b-4bf1-9674-8fd1b2b666d6]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d7c400e-9481-4cea-a8ba-bff56a04f30d tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:21 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Volume volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a (b8b137cc-893e-4ee8-bd46-bf0289fb170a): created successfully Jul 04 00:01:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11e63c6-f4cf-4756-ac73-d678bf88dbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Flow 'volume_create_manager' (574e6b74-870c-48e3-9714-476da6f8c459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:21 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fe13323e-0d36-4c6b-b19a-8894cc10a788 tempest-VolumesSnapshotTestJSON-832763818 None] Created volume successfully. Jul 04 00:01:21 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 Jul 04 00:01:21 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9c1f000a-df1b-41dd-9b66-f96f951fcbf6 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:21 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d7c400e-9481-4cea-a8ba-bff56a04f30d tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984" returned: 0 in 0.794s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7d7c400e-9481-4cea-a8ba-bff56a04f30d tempest-VolumesSnapshotListTestJSON-1668822991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:01:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d7c400e-9481-4cea-a8ba-bff56a04f30d tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:21 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 1G Jul 04 00:01:21 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:22 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d7c400e-9481-4cea-a8ba-bff56a04f30d tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 1G" returned: 0 in 0.850s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d7c400e-9481-4cea-a8ba-bff56a04f30d tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:22 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 Jul 04 00:01:22 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:23 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d7c400e-9481-4cea-a8ba-bff56a04f30d tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9" returned: 0 in 0.709s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:23 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-7d7c400e-9481-4cea-a8ba-bff56a04f30d tempest-VolumesSnapshotListTestJSON-1668822991 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 is being set with open permissions: ugo+rw Jul 04 00:01:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d7c400e-9481-4cea-a8ba-bff56a04f30d tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:23 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 Jul 04 00:01:23 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:24 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d7c400e-9481-4cea-a8ba-bff56a04f30d tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9" returned: 0 in 0.641s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7d7c400e-9481-4cea-a8ba-bff56a04f30d tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.090s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.519s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1062465567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f994995-e00e-481f-b97a-d83c653bf246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='920613d8d84e401bb55ceb100d22083d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:20Z,use_quota=True,user_id='e924d20df0744cb1bbe2b96e6e322b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:01:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Creating volume 6f994995-e00e-481f-b97a-d83c653bf246 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:01:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:01:24 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:01:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6f994995-e00e-481f-b97a-d83c653bf246 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:24 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6f994995-e00e-481f-b97a-d83c653bf246 1073741824 Jul 04 00:01:24 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:24 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7d7c400e-9481-4cea-a8ba-bff56a04f30d tempest-VolumesSnapshotListTestJSON-1668822991 None] Create snapshot completed successfully Jul 04 00:01:25 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6f994995-e00e-481f-b97a-d83c653bf246 1073741824" returned: 0 in 0.900s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6f994995-e00e-481f-b97a-d83c653bf246 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:25 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6f994995-e00e-481f-b97a-d83c653bf246 Jul 04 00:01:25 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e97c2ded-8e4c-4a76-ab55-dbeb3c78bc35 tempest-VolumesSnapshotListTestJSON-1668822991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:25 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6f994995-e00e-481f-b97a-d83c653bf246" returned: 0 in 0.717s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:01:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fd2838ac-037a-44b8-8b2d-429ea7465cf4 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b186c2-be79-43e9-9dad-21ec3ceef113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f994995-e00e-481f-b97a-d83c653bf246', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0568ec-1f52-46f8-b07a-fd94c017c1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fd2838ac-037a-44b8-8b2d-429ea7465cf4 tempest-VolumesDeleteCascade-1265150594 None] Creating offline snapshot b90cdb26-3dcf-4539-8520-720e942cf307 of volume 51db6b09-2f55-4798-9009-4210699d60fa {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:01:25 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Volume volume-6f994995-e00e-481f-b97a-d83c653bf246 (6f994995-e00e-481f-b97a-d83c653bf246): created successfully Jul 04 00:01:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0568ec-1f52-46f8-b07a-fd94c017c1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Flow 'volume_create_manager' (e3488ccd-9b73-497b-9a4a-b61305f8d279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:25 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[11410a47-4594-47b5-be6a-8813252f1d49]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fd2838ac-037a-44b8-8b2d-429ea7465cf4 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:25 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-01a0cd8e-7880-4037-8323-8a982b2b2df5 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Created volume successfully. Jul 04 00:01:26 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 Jul 04 00:01:26 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:26 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fd2838ac-037a-44b8-8b2d-429ea7465cf4 tempest-VolumesDeleteCascade-1265150594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862" returned: 0 in 0.787s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fd2838ac-037a-44b8-8b2d-429ea7465cf4 tempest-VolumesDeleteCascade-1265150594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51db6b09-2f55-4798-9009-4210699d60fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:01:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fd2838ac-037a-44b8-8b2d-429ea7465cf4 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:26 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307 1G Jul 04 00:01:26 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=165,cinder:INSERT=42,cinder:SELECT=135,cinder:DELETE=14 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Flow 'volume_create_manager' (a710bddf-e611-4eda-9784-3f1d1016fc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3bc077-806b-4689-a85e-5a92901eefee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3bc077-806b-4689-a85e-5a92901eefee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1634837215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67122b5-bab7-44fd-9fd8-f8af9efb3149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='920613d8d84e401bb55ceb100d22083d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:27Z,use_quota=True,user_id='e924d20df0744cb1bbe2b96e6e322b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f787fa-1a50-437e-a9d3-6ef620db21ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f787fa-1a50-437e-a9d3-6ef620db21ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f9ed46-4768-4f90-b32f-1925529aa1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f9ed46-4768-4f90-b32f-1925529aa1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a67122b5-bab7-44fd-9fd8-f8af9efb3149', 'volume_name': 'volume-a67122b5-bab7-44fd-9fd8-f8af9efb3149', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95eb0653-aa12-450f-9f14-fd3121283217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95eb0653-aa12-450f-9f14-fd3121283217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83b1754-70d6-4a44-9bb5-8ebd201ae00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:27 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Volume a67122b5-bab7-44fd-9fd8-f8af9efb3149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a67122b5-bab7-44fd-9fd8-f8af9efb3149', 'volume_size': 1} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:27 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fd2838ac-037a-44b8-8b2d-429ea7465cf4 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307 1G" returned: 0 in 1.004s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fd2838ac-037a-44b8-8b2d-429ea7465cf4 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:27 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307 Jul 04 00:01:27 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Flow 'volume_create_manager' (dca9b47b-9446-47b4-8bd9-5ec894c58afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4850d5a7-f85b-4187-9c69-f0b555121341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4850d5a7-f85b-4187-9c69-f0b555121341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-506483982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45da9889-1153-4a45-9213-ce256ae0324c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='920613d8d84e401bb55ceb100d22083d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:28Z,use_quota=True,user_id='e924d20df0744cb1bbe2b96e6e322b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc454722-733e-4e62-bc91-2d56f21c62a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc454722-733e-4e62-bc91-2d56f21c62a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a25857-1b74-4607-a6c4-2af6957a79db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a25857-1b74-4607-a6c4-2af6957a79db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45da9889-1153-4a45-9213-ce256ae0324c', 'volume_name': 'volume-45da9889-1153-4a45-9213-ce256ae0324c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29929154-8fe1-4373-af93-47a8220dae21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29929154-8fe1-4373-af93-47a8220dae21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa6feb9-74d3-4181-a9e7-a3461fccb740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:27 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Volume 45da9889-1153-4a45-9213-ce256ae0324c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45da9889-1153-4a45-9213-ce256ae0324c', 'volume_size': 1} Jul 04 00:01:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Flow 'volume_create_manager' (af73f80d-e0ee-4c6e-9cb3-3ebbe1013b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf88bd2-a241-4878-befe-91d6cc24cda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf88bd2-a241-4878-befe-91d6cc24cda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-879514182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7043d655-179f-4ec4-a01f-916f273969c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='920613d8d84e401bb55ceb100d22083d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:28Z,use_quota=True,user_id='e924d20df0744cb1bbe2b96e6e322b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab9744e-c13b-49a9-bcda-a040b750e7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab9744e-c13b-49a9-bcda-a040b750e7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0de5d3-c421-4511-a9f4-5b1ec41a14f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0de5d3-c421-4511-a9f4-5b1ec41a14f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7043d655-179f-4ec4-a01f-916f273969c4', 'volume_name': 'volume-7043d655-179f-4ec4-a01f-916f273969c4', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f246090-05cf-4a7e-ac86-cacc1f88be48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f246090-05cf-4a7e-ac86-cacc1f88be48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0b085b-8510-4bb7-8479-526f2167da5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:28 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Volume 7043d655-179f-4ec4-a01f-916f273969c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7043d655-179f-4ec4-a01f-916f273969c4', 'volume_size': 1} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:28 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fd2838ac-037a-44b8-8b2d-429ea7465cf4 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307" returned: 0 in 0.900s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:28 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-fd2838ac-037a-44b8-8b2d-429ea7465cf4 tempest-VolumesDeleteCascade-1265150594 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307 is being set with open permissions: ugo+rw Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fd2838ac-037a-44b8-8b2d-429ea7465cf4 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:01:28 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307 Jul 04 00:01:28 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Flow 'volume_create_manager' (c613b4ee-d711-4470-bed3-869d04306ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9eb1e5-4886-488b-8f1e-7c9e34863f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9eb1e5-4886-488b-8f1e-7c9e34863f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-624101869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87749398-e306-43c4-80b0-9d71fe031888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='920613d8d84e401bb55ceb100d22083d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:29Z,use_quota=True,user_id='e924d20df0744cb1bbe2b96e6e322b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d89c17-6f9d-4154-a13f-f2824cdc271c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d89c17-6f9d-4154-a13f-f2824cdc271c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a707b375-7e0a-4527-9d42-897b7955fab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a707b375-7e0a-4527-9d42-897b7955fab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87749398-e306-43c4-80b0-9d71fe031888', 'volume_name': 'volume-87749398-e306-43c4-80b0-9d71fe031888', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322851ec-eb82-4cba-9b6c-3ed952e5cdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322851ec-eb82-4cba-9b6c-3ed952e5cdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (165c786e-2856-4d1c-9e71-b0ae51bdeacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:28 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Volume 87749398-e306-43c4-80b0-9d71fe031888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87749398-e306-43c4-80b0-9d71fe031888', 'volume_size': 1} Jul 04 00:01:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:29 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:01:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Flow 'volume_create_manager' (9db801a1-6f8f-4c18-9f7e-6bb2377196cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e386978a-9890-4b0f-b832-2ff4d221647d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e386978a-9890-4b0f-b832-2ff4d221647d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-755363529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edbeb970-b800-43d3-93a1-27c42c895165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='920613d8d84e401bb55ceb100d22083d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:29Z,use_quota=True,user_id='e924d20df0744cb1bbe2b96e6e322b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884617a0-db1a-4df3-bd19-7894d33fdd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884617a0-db1a-4df3-bd19-7894d33fdd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4771a7f3-d6ed-4b69-bd4f-20a0783ce14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4771a7f3-d6ed-4b69-bd4f-20a0783ce14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edbeb970-b800-43d3-93a1-27c42c895165', 'volume_name': 'volume-edbeb970-b800-43d3-93a1-27c42c895165', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d126a52b-9563-41da-bd19-5229967ca3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d126a52b-9563-41da-bd19-5229967ca3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f089e3-46e8-405c-9476-e872aba81946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:29 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Volume edbeb970-b800-43d3-93a1-27c42c895165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edbeb970-b800-43d3-93a1-27c42c895165', 'volume_size': 1} Jul 04 00:01:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:29 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fd2838ac-037a-44b8-8b2d-429ea7465cf4 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307" returned: 0 in 0.711s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fd2838ac-037a-44b8-8b2d-429ea7465cf4 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.534s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9c1f000a-df1b-41dd-9b66-f96f951fcbf6 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.889s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9c1f000a-df1b-41dd-9b66-f96f951fcbf6 tempest-VolumesSnapshotTestJSON-832763818 None] Creating offline snapshot 98944fc7-4bf0-40b5-810e-8c20309d5e29 of volume b8b137cc-893e-4ee8-bd46-bf0289fb170a {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:01:29 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03dc919-1a10-4b84-90db-e756451d28f8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c1f000a-df1b-41dd-9b66-f96f951fcbf6 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:29 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fd2838ac-037a-44b8-8b2d-429ea7465cf4 tempest-VolumesDeleteCascade-1265150594 None] Create snapshot completed successfully Jul 04 00:01:29 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a Jul 04 00:01:29 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:30 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c1f000a-df1b-41dd-9b66-f96f951fcbf6 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a" returned: 0 in 0.771s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c1f000a-df1b-41dd-9b66-f96f951fcbf6 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:30 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29 1G Jul 04 00:01:30 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "cinder-51db6b09-2f55-4798-9009-4210699d60fa-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-51db6b09-2f55-4798-9009-4210699d60fa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Performing cascade delete. {{(pid=86676) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Jul 04 00:01:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "cinder-b90cdb26-3dcf-4539-8520-720e942cf307-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-b90cdb26-3dcf-4539-8520-720e942cf307-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "cinder-quobyte-51db6b09-2f55-4798-9009-4210699d60fa" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-51db6b09-2f55-4798-9009-4210699d60fa" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "cinder-quobyte-b90cdb26-3dcf-4539-8520-720e942cf307" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-b90cdb26-3dcf-4539-8520-720e942cf307" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Deleting offline snapshot b90cdb26-3dcf-4539-8520-720e942cf307 of volume 51db6b09-2f55-4798-9009-4210699d60fa {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:01:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] snapshot_file for this snap is: volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:01:30 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3d75f6-395d-443b-8006-57fa41839857]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:30 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307 Jul 04 00:01:30 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:31 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c1f000a-df1b-41dd-9b66-f96f951fcbf6 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29 1G" returned: 0 in 0.863s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c1f000a-df1b-41dd-9b66-f96f951fcbf6 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:31 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29 Jul 04 00:01:31 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:31 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307" returned: 0 in 0.817s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51db6b09-2f55-4798-9009-4210699d60fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:01:31 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d4da70-faf3-43a5-b0d9-5568b198e52a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:31 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 Jul 04 00:01:31 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:31 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c1f000a-df1b-41dd-9b66-f96f951fcbf6 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29" returned: 0 in 0.719s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:31 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-9c1f000a-df1b-41dd-9b66-f96f951fcbf6 tempest-VolumesSnapshotTestJSON-832763818 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29 is being set with open permissions: ugo+rw Jul 04 00:01:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c1f000a-df1b-41dd-9b66-f96f951fcbf6 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:31 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29 Jul 04 00:01:31 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:32 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862" returned: 0 in 0.790s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51db6b09-2f55-4798-9009-4210699d60fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:01:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:32 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307 Jul 04 00:01:32 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:32 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c1f000a-df1b-41dd-9b66-f96f951fcbf6 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29" returned: 0 in 0.648s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c1f000a-df1b-41dd-9b66-f96f951fcbf6 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:32 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.info Jul 04 00:01:32 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:32 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307" returned: 0 in 0.831s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:32 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307 Jul 04 00:01:32 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:33 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c1f000a-df1b-41dd-9b66-f96f951fcbf6 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.info" returned: 0 in 0.659s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:33 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-9c1f000a-df1b-41dd-9b66-f96f951fcbf6 tempest-VolumesSnapshotTestJSON-832763818 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.info is being set with open permissions: ugo+rw Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c1f000a-df1b-41dd-9b66-f96f951fcbf6 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:33 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.info Jul 04 00:01:33 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:33 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:01:33 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:33 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.b90cdb26-3dcf-4539-8520-720e942cf307" returned: 0 in 0.747s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-b90cdb26-3dcf-4539-8520-720e942cf307" released by "_delete_snapshot" :: held 3.283s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-51db6b09-2f55-4798-9009-4210699d60fa" released by "delete_snapshot" :: held 3.312s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=161,cinder:SELECT=134,cinder:INSERT=47,cinder:DELETE=17 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Created reservations ['287d85e4-8e60-48c9-bc38-34bd52eb59ff', 'f7b2c84f-bd55-47b3-b7b2-d3540d2c723e', 'a6f3a8dc-17c5-4f0c-94cd-f1332757f1a5', 'c795d414-e24a-4ead-9d3d-b0a74ff64e82'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:33 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Delete snapshot completed successfully. Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-b90cdb26-3dcf-4539-8520-720e942cf307-delete_snapshot" released by "delete_snapshot" :: held 3.501s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "cinder-e8280d05-2ee6-4826-b5ec-476b00f65862-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-e8280d05-2ee6-4826-b5ec-476b00f65862-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:33 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c1f000a-df1b-41dd-9b66-f96f951fcbf6 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.info" returned: 0 in 0.734s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9c1f000a-df1b-41dd-9b66-f96f951fcbf6 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.525s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e97c2ded-8e4c-4a76-ab55-dbeb3c78bc35 tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.689s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "cinder-quobyte-51db6b09-2f55-4798-9009-4210699d60fa" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e97c2ded-8e4c-4a76-ab55-dbeb3c78bc35 tempest-VolumesSnapshotListTestJSON-1668822991 None] Creating offline snapshot 12499bbd-024e-4508-b916-4a19ebae9ad6 of volume a62363fd-8cb8-49f0-afd6-628ab1f13c73 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-51db6b09-2f55-4798-9009-4210699d60fa" acquired by "delete_snapshot" :: waited 0.067s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "cinder-quobyte-e8280d05-2ee6-4826-b5ec-476b00f65862" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:33 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9c1f000a-df1b-41dd-9b66-f96f951fcbf6 tempest-VolumesSnapshotTestJSON-832763818 None] Create snapshot completed successfully Jul 04 00:01:34 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9286675e-37ef-48bf-9b3b-4d80ec6f33ad]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-e8280d05-2ee6-4826-b5ec-476b00f65862" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Deleting offline snapshot e8280d05-2ee6-4826-b5ec-476b00f65862 of volume 51db6b09-2f55-4798-9009-4210699d60fa {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:01:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] snapshot_file for this snap is: volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:01:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e97c2ded-8e4c-4a76-ab55-dbeb3c78bc35 tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:34 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d62a368-7daa-4340-b5aa-781dfc636104]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:34 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.688s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:01:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:01:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:01:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:01:34 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 Jul 04 00:01:34 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 Jul 04 00:01:34 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:34 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:34 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e97c2ded-8e4c-4a76-ab55-dbeb3c78bc35 tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9" returned: 0 in 0.804s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e97c2ded-8e4c-4a76-ab55-dbeb3c78bc35 tempest-VolumesSnapshotListTestJSON-1668822991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:01:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e97c2ded-8e4c-4a76-ab55-dbeb3c78bc35 tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:34 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862" returned: 0 in 0.809s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51db6b09-2f55-4798-9009-4210699d60fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:01:34 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6 1G Jul 04 00:01:34 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:34 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc7a880-6e67-41c4-8c9d-01aa9095cd61]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:35 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa Jul 04 00:01:35 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:35 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:01:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Flow 'volume_create_manager' (ee72436d-9594-4fd1-a0c4-e92c8f1de89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9620ff6-47e3-4495-af05-631f780e2861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9620ff6-47e3-4495-af05-631f780e2861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-952659630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c65211-dc51-4e70-a693-418e7f059c3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f44bf73a1e3a4a51b51a4251f24b75d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=98944fc7-4bf0-40b5-810e-8c20309d5e29,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:36Z,use_quota=True,user_id='eb5f08484c074c6ab33469a1f0a69322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c60e0cf-cb47-44e0-88a4-859d6a84df84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c60e0cf-cb47-44e0-88a4-859d6a84df84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (548634ae-7fce-409c-ad1d-5cd27b92c7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (548634ae-7fce-409c-ad1d-5cd27b92c7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f4c65211-dc51-4e70-a693-418e7f059c3d', 'volume_name': 'volume-f4c65211-dc51-4e70-a693-418e7f059c3d', 'volume_size': 1, 'snapshot_id': '98944fc7-4bf0-40b5-810e-8c20309d5e29'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8e8c2c-9818-4677-b39a-929818456eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8e8c2c-9818-4677-b39a-929818456eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c45940-b5be-49ef-944d-86b808a5a18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:35 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Volume f4c65211-dc51-4e70-a693-418e7f059c3d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f4c65211-dc51-4e70-a693-418e7f059c3d', 'volume_size': 1, 'snapshot_id': '98944fc7-4bf0-40b5-810e-8c20309d5e29'} Jul 04 00:01:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:35 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa" returned: 0 in 0.928s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:35 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e97c2ded-8e4c-4a76-ab55-dbeb3c78bc35 tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6 1G" returned: 0 in 0.994s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e97c2ded-8e4c-4a76-ab55-dbeb3c78bc35 tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:35 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 Jul 04 00:01:35 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:35 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6 Jul 04 00:01:35 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:36 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e97c2ded-8e4c-4a76-ab55-dbeb3c78bc35 tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6" returned: 0 in 0.720s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:36 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-e97c2ded-8e4c-4a76-ab55-dbeb3c78bc35 tempest-VolumesSnapshotListTestJSON-1668822991 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6 is being set with open permissions: ugo+rw Jul 04 00:01:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e97c2ded-8e4c-4a76-ab55-dbeb3c78bc35 tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:36 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6 Jul 04 00:01:36 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:36 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862" returned: 0 in 0.790s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:36 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862 Jul 04 00:01:36 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:37 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e97c2ded-8e4c-4a76-ab55-dbeb3c78bc35 tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6" returned: 0 in 0.719s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:37 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e97c2ded-8e4c-4a76-ab55-dbeb3c78bc35 tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.399s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.794s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1634837215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67122b5-bab7-44fd-9fd8-f8af9efb3149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='920613d8d84e401bb55ceb100d22083d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:27Z,use_quota=True,user_id='e924d20df0744cb1bbe2b96e6e322b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Creating volume a67122b5-bab7-44fd-9fd8-f8af9efb3149 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:01:37 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a67122b5-bab7-44fd-9fd8-f8af9efb3149 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa.e8280d05-2ee6-4826-b5ec-476b00f65862" returned: 0 in 0.719s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:37 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a67122b5-bab7-44fd-9fd8-f8af9efb3149 1073741824 Jul 04 00:01:37 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-e8280d05-2ee6-4826-b5ec-476b00f65862" released by "_delete_snapshot" :: held 3.372s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-51db6b09-2f55-4798-9009-4210699d60fa" released by "delete_snapshot" :: held 3.409s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:37 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e97c2ded-8e4c-4a76-ab55-dbeb3c78bc35 tempest-VolumesSnapshotListTestJSON-1668822991 None] Create snapshot completed successfully Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Created reservations ['28389a10-edb6-41b3-991f-4db4d0d724ff', '3f9c97bb-7879-4581-819d-4a8e81c4cd59', '2a23de23-3343-43a4-8b5a-6858e1847451', 'c23c0559-cac9-4fd8-96f3-1e53ca48c7d4'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:37 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Delete snapshot completed successfully. Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-e8280d05-2ee6-4826-b5ec-476b00f65862-delete_snapshot" released by "delete_snapshot" :: held 3.692s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Snapshots deleted, issuing volume delete {{(pid=86676) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "cinder-quobyte-51db6b09-2f55-4798-9009-4210699d60fa" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-51db6b09-2f55-4798-9009-4210699d60fa" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebb073e-5e5e-4ffd-94f5-bec2342d2ccd]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:37 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa Jul 04 00:01:37 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:38 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a67122b5-bab7-44fd-9fd8-f8af9efb3149 1073741824" returned: 0 in 0.955s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a67122b5-bab7-44fd-9fd8-f8af9efb3149 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:38 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a67122b5-bab7-44fd-9fd8-f8af9efb3149 Jul 04 00:01:38 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:38 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa" returned: 0 in 0.892s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:38 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa Jul 04 00:01:38 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] Acquiring lock "cinder-12499bbd-024e-4508-b916-4a19ebae9ad6-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-12499bbd-024e-4508-b916-4a19ebae9ad6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] Acquiring lock "cinder-quobyte-a62363fd-8cb8-49f0-afd6-628ab1f13c73" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-quobyte-a62363fd-8cb8-49f0-afd6-628ab1f13c73" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] Acquiring lock "cinder-quobyte-12499bbd-024e-4508-b916-4a19ebae9ad6" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-quobyte-12499bbd-024e-4508-b916-4a19ebae9ad6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] Deleting offline snapshot 12499bbd-024e-4508-b916-4a19ebae9ad6 of volume a62363fd-8cb8-49f0-afd6-628ab1f13c73 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:01:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] snapshot_file for this snap is: volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:01:38 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a031ed85-cd6e-40fd-a3c2-3a28a7a4d1c2]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:38 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6 Jul 04 00:01:38 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:39 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a67122b5-bab7-44fd-9fd8-f8af9efb3149" returned: 0 in 0.737s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.092s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-506483982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45da9889-1153-4a45-9213-ce256ae0324c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='920613d8d84e401bb55ceb100d22083d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:28Z,use_quota=True,user_id='e924d20df0744cb1bbe2b96e6e322b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Creating volume 45da9889-1153-4a45-9213-ce256ae0324c {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:01:39 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45da9889-1153-4a45-9213-ce256ae0324c 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:39 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45da9889-1153-4a45-9213-ce256ae0324c 1073741824 Jul 04 00:01:39 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83b1754-70d6-4a44-9bb5-8ebd201ae00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a67122b5-bab7-44fd-9fd8-f8af9efb3149', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8a8651-8011-4e7d-b6b5-f6171d9a1ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:39 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Volume volume-a67122b5-bab7-44fd-9fd8-f8af9efb3149 (a67122b5-bab7-44fd-9fd8-f8af9efb3149): created successfully Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8a8651-8011-4e7d-b6b5-f6171d9a1ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Flow 'volume_create_manager' (a710bddf-e611-4eda-9784-3f1d1016fc91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:39 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3235110f-4054-4d25-89d8-f1ab7028c950 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Created volume successfully. Jul 04 00:01:39 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51db6b09-2f55-4798-9009-4210699d60fa" returned: 0 in 0.779s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-51db6b09-2f55-4798-9009-4210699d60fa" released by "delete_volume" :: held 1.752s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Created reservations ['35ea7eeb-5a7a-4227-a31f-0fe74713fbbf', 'cd3afcf9-b8e4-4f19-a1a7-1503c1d1f18f', 'eb1df7b6-c27a-45ea-abcd-fccea67eab8c', 'c6b85696-2138-480a-a3b2-42aa16887e6d'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:39 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:01:39 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:39 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6" returned: 0 in 0.883s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2755a55b-9d8c-4310-83f9-2cb665802552]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:39 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 Jul 04 00:01:39 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:40 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45da9889-1153-4a45-9213-ce256ae0324c 1073741824" returned: 0 in 1.021s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45da9889-1153-4a45-9213-ce256ae0324c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:40 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45da9889-1153-4a45-9213-ce256ae0324c Jul 04 00:01:40 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:40 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.913s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:01:40 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Deleted volume successfully. Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-332a798a-6fb1-49ce-8891-532447bb93d4 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-51db6b09-2f55-4798-9009-4210699d60fa-delete_volume" released by "delete_volume" :: held 10.162s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:40 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9" returned: 0 in 0.917s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:40 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6 Jul 04 00:01:40 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Flow 'volume_create_manager' (aa2cb289-c504-4d5e-a447-8f108cb92f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264d86b9-b604-4d88-9c46-720b73ce3f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264d86b9-b604-4d88-9c46-720b73ce3f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1546602327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d798f2-ce28-4d97-9d3a-0290bd3032f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8bcd0e2b134119b1f659465aa20641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:41Z,use_quota=True,user_id='4d079cbf15874ed2a0ccaaa3d285b1ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23d9bcb-f8ea-48a6-a66b-0790046d73f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23d9bcb-f8ea-48a6-a66b-0790046d73f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17f8ea5-d951-44d8-b87f-d5e59fbc4c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17f8ea5-d951-44d8-b87f-d5e59fbc4c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d798f2-ce28-4d97-9d3a-0290bd3032f8', 'volume_name': 'volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b999c82d-d1b8-49f4-ab56-746f0634602f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b999c82d-d1b8-49f4-ab56-746f0634602f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16babf80-3b33-4d63-beed-4bdae8a43302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:40 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Volume 96d798f2-ce28-4d97-9d3a-0290bd3032f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8', 'volume_size': 1} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:40 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45da9889-1153-4a45-9213-ce256ae0324c" returned: 0 in 0.752s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.604s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-879514182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7043d655-179f-4ec4-a01f-916f273969c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='920613d8d84e401bb55ceb100d22083d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:28Z,use_quota=True,user_id='e924d20df0744cb1bbe2b96e6e322b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Creating volume 7043d655-179f-4ec4-a01f-916f273969c4 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:01:40 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7043d655-179f-4ec4-a01f-916f273969c4 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:40 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7043d655-179f-4ec4-a01f-916f273969c4 1073741824 Jul 04 00:01:40 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa6feb9-74d3-4181-a9e7-a3461fccb740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45da9889-1153-4a45-9213-ce256ae0324c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584c1e3a-5db0-4a2d-a761-22050d0e5815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:40 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Volume volume-45da9889-1153-4a45-9213-ce256ae0324c (45da9889-1153-4a45-9213-ce256ae0324c): created successfully Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584c1e3a-5db0-4a2d-a761-22050d0e5815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Flow 'volume_create_manager' (dca9b47b-9446-47b4-8bd9-5ec894c58afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:40 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-585089d0-3714-4af4-9714-47e060e203a8 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Created volume successfully. Jul 04 00:01:41 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6" returned: 0 in 0.921s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:41 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6 Jul 04 00:01:41 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:41 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7043d655-179f-4ec4-a01f-916f273969c4 1073741824" returned: 0 in 0.911s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7043d655-179f-4ec4-a01f-916f273969c4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:41 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7043d655-179f-4ec4-a01f-916f273969c4 Jul 04 00:01:41 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:42 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.12499bbd-024e-4508-b916-4a19ebae9ad6" returned: 0 in 0.684s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-quobyte-12499bbd-024e-4508-b916-4a19ebae9ad6" released by "_delete_snapshot" :: held 3.549s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-quobyte-a62363fd-8cb8-49f0-afd6-628ab1f13c73" released by "delete_snapshot" :: held 3.583s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] Created reservations ['c933a859-1df7-4b10-b317-dc55b5ea29f6', 'd8804967-f8e7-4e20-a61f-6853f17e2e90', '7769eaf9-8089-4bb5-a741-0fe7748f5cc1', '86247e48-654d-4a65-96e1-0cf3d6c89900'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:42 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] Delete snapshot completed successfully. Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c00c546a-bc82-491f-8db1-43a32e748462 tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-12499bbd-024e-4508-b916-4a19ebae9ad6-delete_snapshot" released by "delete_snapshot" :: held 3.736s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:42 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7043d655-179f-4ec4-a01f-916f273969c4" returned: 0 in 0.673s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.800s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-624101869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87749398-e306-43c4-80b0-9d71fe031888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='920613d8d84e401bb55ceb100d22083d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:29Z,use_quota=True,user_id='e924d20df0744cb1bbe2b96e6e322b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Creating volume 87749398-e306-43c4-80b0-9d71fe031888 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:01:42 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-87749398-e306-43c4-80b0-9d71fe031888 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:42 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-87749398-e306-43c4-80b0-9d71fe031888 1073741824 Jul 04 00:01:42 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0b085b-8510-4bb7-8479-526f2167da5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7043d655-179f-4ec4-a01f-916f273969c4', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c669f74c-ebf3-4cf5-b31e-c628e1fcc38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:42 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Volume volume-7043d655-179f-4ec4-a01f-916f273969c4 (7043d655-179f-4ec4-a01f-916f273969c4): created successfully Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c669f74c-ebf3-4cf5-b31e-c628e1fcc38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Flow 'volume_create_manager' (af73f80d-e0ee-4c6e-9cb3-3ebbe1013b5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:42 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-bf729b25-11e1-48de-83fd-15ffe7163082 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Created volume successfully. Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] Acquiring lock "cinder-24e78a0a-830a-4e24-a3d9-697c292bf3f9-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-24e78a0a-830a-4e24-a3d9-697c292bf3f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] Acquiring lock "cinder-quobyte-a62363fd-8cb8-49f0-afd6-628ab1f13c73" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-quobyte-a62363fd-8cb8-49f0-afd6-628ab1f13c73" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] Acquiring lock "cinder-quobyte-24e78a0a-830a-4e24-a3d9-697c292bf3f9" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-quobyte-24e78a0a-830a-4e24-a3d9-697c292bf3f9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] Deleting offline snapshot 24e78a0a-830a-4e24-a3d9-697c292bf3f9 of volume a62363fd-8cb8-49f0-afd6-628ab1f13c73 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] snapshot_file for this snap is: volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a231bed-03c2-4ad3-aea6-474af103f2b7]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:43 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 Jul 04 00:01:43 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:43 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-87749398-e306-43c4-80b0-9d71fe031888 1073741824" returned: 0 in 0.876s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-87749398-e306-43c4-80b0-9d71fe031888 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:43 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-87749398-e306-43c4-80b0-9d71fe031888 Jul 04 00:01:43 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:43 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9" returned: 0 in 0.810s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:01:43 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f58618-e081-446e-9e20-44fed5764434]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:43 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 Jul 04 00:01:43 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:44 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-87749398-e306-43c4-80b0-9d71fe031888" returned: 0 in 0.693s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.064s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-755363529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edbeb970-b800-43d3-93a1-27c42c895165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='920613d8d84e401bb55ceb100d22083d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:29Z,use_quota=True,user_id='e924d20df0744cb1bbe2b96e6e322b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Creating volume edbeb970-b800-43d3-93a1-27c42c895165 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:01:44 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-edbeb970-b800-43d3-93a1-27c42c895165 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:44 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-edbeb970-b800-43d3-93a1-27c42c895165 1073741824 Jul 04 00:01:44 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (165c786e-2856-4d1c-9e71-b0ae51bdeacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87749398-e306-43c4-80b0-9d71fe031888', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e199a88-15b8-4770-a270-eed46a7378af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:44 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Volume volume-87749398-e306-43c4-80b0-9d71fe031888 (87749398-e306-43c4-80b0-9d71fe031888): created successfully Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e199a88-15b8-4770-a270-eed46a7378af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Flow 'volume_create_manager' (c613b4ee-d711-4470-bed3-869d04306ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:44 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6cd3ddd7-dbf1-4702-a398-f53f5f57657c tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Created volume successfully. Jul 04 00:01:44 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984" returned: 0 in 0.792s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:01:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:44 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 Jul 04 00:01:44 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:45 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-edbeb970-b800-43d3-93a1-27c42c895165 1073741824" returned: 0 in 0.891s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-edbeb970-b800-43d3-93a1-27c42c895165 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:45 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-edbeb970-b800-43d3-93a1-27c42c895165 Jul 04 00:01:45 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:45 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9" returned: 0 in 0.813s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:45 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9 Jul 04 00:01:45 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:45 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-edbeb970-b800-43d3-93a1-27c42c895165" returned: 0 in 0.673s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.003s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-quobyte-98944fc7-4bf0-40b5-810e-8c20309d5e29-f4c65211-dc51-4e70-a693-418e7f059c3d" by "_create_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f089e3-46e8-405c-9476-e872aba81946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edbeb970-b800-43d3-93a1-27c42c895165', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576e9d16-8135-4e26-b3a3-a548a6a5b36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-98944fc7-4bf0-40b5-810e-8c20309d5e29-f4c65211-dc51-4e70-a693-418e7f059c3d" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Creating volume f4c65211-dc51-4e70-a693-418e7f059c3d from snapshot 98944fc7-4bf0-40b5-810e-8c20309d5e29 {{(pid=86676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-quobyte-f4c65211-dc51-4e70-a693-418e7f059c3d" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:45 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Volume volume-edbeb970-b800-43d3-93a1-27c42c895165 (edbeb970-b800-43d3-93a1-27c42c895165): created successfully Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576e9d16-8135-4e26-b3a3-a548a6a5b36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Flow 'volume_create_manager' (9db801a1-6f8f-4c18-9f7e-6bb2377196cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-f4c65211-dc51-4e70-a693-418e7f059c3d" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] snapshot: 98944fc7-4bf0-40b5-810e-8c20309d5e29, volume: f4c65211-dc51-4e70-a693-418e7f059c3d, {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 04 00:01:45 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-03b6baf5-3296-4b22-84f0-7e4d9b067259 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Created volume successfully. Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cac1c1-0d07-4498-b4a5-dc4ac1ca8415]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:46 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29 Jul 04 00:01:46 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:46 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.24e78a0a-830a-4e24-a3d9-697c292bf3f9" returned: 0 in 0.664s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-quobyte-24e78a0a-830a-4e24-a3d9-697c292bf3f9" released by "_delete_snapshot" :: held 3.198s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-quobyte-a62363fd-8cb8-49f0-afd6-628ab1f13c73" released by "delete_snapshot" :: held 3.225s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:46 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] Created reservations ['85d2b9f4-0d12-4a87-a1d4-390489a8e575', '7071e2dc-c483-4fd2-a686-c0fa7bb249b0', 'ba8e4fb6-eb87-4419-b371-a8b5973c7f9a', '9d0a249a-d6aa-4a2b-b8a4-1eadc6a55da0'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:46 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] Delete snapshot completed successfully. Jul 04 00:01:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1ee3d276-9a66-4f7a-9773-4c59a6d56f3d tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-24e78a0a-830a-4e24-a3d9-697c292bf3f9-delete_snapshot" released by "delete_snapshot" :: held 3.375s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "cinder-edbeb970-b800-43d3-93a1-27c42c895165-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-edbeb970-b800-43d3-93a1-27c42c895165-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "cinder-quobyte-edbeb970-b800-43d3-93a1-27c42c895165" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-quobyte-edbeb970-b800-43d3-93a1-27c42c895165" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dade93b-f30d-4f7d-886d-e0cef4d5e339]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-edbeb970-b800-43d3-93a1-27c42c895165 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:46 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-edbeb970-b800-43d3-93a1-27c42c895165 Jul 04 00:01:46 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:46 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29" returned: 0 in 0.800s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:01:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 04 00:01:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 04 00:01:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c26e77b-3c22-4e28-b3b7-dbef55a3232a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:46 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a Jul 04 00:01:46 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] Acquiring lock "cinder-ecd341f3-141e-4afc-8285-891e42b78984-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-ecd341f3-141e-4afc-8285-891e42b78984-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] Acquiring lock "cinder-quobyte-a62363fd-8cb8-49f0-afd6-628ab1f13c73" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-quobyte-a62363fd-8cb8-49f0-afd6-628ab1f13c73" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] Acquiring lock "cinder-quobyte-ecd341f3-141e-4afc-8285-891e42b78984" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-quobyte-ecd341f3-141e-4afc-8285-891e42b78984" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] Deleting offline snapshot ecd341f3-141e-4afc-8285-891e42b78984 of volume a62363fd-8cb8-49f0-afd6-628ab1f13c73 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:01:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] snapshot_file for this snap is: volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:01:47 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f45ca26-dff2-444d-8b89-8814a914a613]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:47 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-edbeb970-b800-43d3-93a1-27c42c895165" returned: 0 in 0.800s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-edbeb970-b800-43d3-93a1-27c42c895165 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:47 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 Jul 04 00:01:47 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:47 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-edbeb970-b800-43d3-93a1-27c42c895165 Jul 04 00:01:47 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:47 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a" returned: 0 in 0.877s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:47 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Path /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4c65211-dc51-4e70-a693-418e7f059c3d not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 04 00:01:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4c65211-dc51-4e70-a693-418e7f059c3d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:47 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4c65211-dc51-4e70-a693-418e7f059c3d Jul 04 00:01:47 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:47 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-edbeb970-b800-43d3-93a1-27c42c895165" returned: 0 in 0.691s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-quobyte-edbeb970-b800-43d3-93a1-27c42c895165" released by "delete_volume" :: held 1.544s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:48 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984" returned: 0 in 0.838s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:01:48 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[602dd827-1a7f-4b46-8b1d-2b15ae6cdcde]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:48 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Created reservations ['cdf1fa10-5633-4803-bcca-cae40cd5a062', 'fc9efac5-4d45-49a7-a759-a78cade73618', '26bb4374-bd41-40c5-b0bd-9ab463e2bbb2', '0bfa634c-4c08-4884-94f0-0b97b75120a7'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:48 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73 Jul 04 00:01:48 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:48 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:01:48 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "cinder-87749398-e306-43c4-80b0-9d71fe031888-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-87749398-e306-43c4-80b0-9d71fe031888-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "cinder-quobyte-87749398-e306-43c4-80b0-9d71fe031888" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-quobyte-87749398-e306-43c4-80b0-9d71fe031888" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:49 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9231a36f-328e-4592-b5b6-0611fb9fef1d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-87749398-e306-43c4-80b0-9d71fe031888 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:49 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-87749398-e306-43c4-80b0-9d71fe031888 Jul 04 00:01:49 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:49 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.448s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:49 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:01:49 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Deleted volume successfully. Jul 04 00:01:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d16e85b0-048d-4f5b-98c7-e2270e15f7ef tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-edbeb970-b800-43d3-93a1-27c42c895165-delete_volume" released by "delete_volume" :: held 3.330s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:49 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73" returned: 0 in 1.770s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:49 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 Jul 04 00:01:49 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:50 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-87749398-e306-43c4-80b0-9d71fe031888" returned: 0 in 1.864s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-87749398-e306-43c4-80b0-9d71fe031888 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:51 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-87749398-e306-43c4-80b0-9d71fe031888 Jul 04 00:01:51 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:51 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984" returned: 0 in 1.802s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:51 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984 Jul 04 00:01:51 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:52 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-87749398-e306-43c4-80b0-9d71fe031888" returned: 0 in 1.945s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-quobyte-87749398-e306-43c4-80b0-9d71fe031888" released by "delete_volume" :: held 3.926s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Created reservations ['5de953c6-3bf7-4091-9836-5505f9ea9aec', 'b01ffa22-ba24-49c4-8f6b-799edf09777f', '3c7fe635-29ec-4c56-b595-09824f503f3c', '21462dea-0a35-4dda-abd9-6d3c0006815c'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:53 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73.ecd341f3-141e-4afc-8285-891e42b78984" returned: 0 in 1.546s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:53 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:01:53 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-quobyte-ecd341f3-141e-4afc-8285-891e42b78984" released by "_delete_snapshot" :: held 6.097s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:53 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-quobyte-a62363fd-8cb8-49f0-afd6-628ab1f13c73" released by "delete_snapshot" :: held 6.124s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4c65211-dc51-4e70-a693-418e7f059c3d" returned: 0 in 5.665s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce84ca37-359e-4817-aa16-268e3ec5e76d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] Created reservations ['6e244c82-b98c-4b2d-9b0f-cd8bdb494391', '234f995b-61bb-44af-b81d-07a2ff2246b3', '32b29a1b-f0f6-4709-9632-5bdbb2c73a3c', 'eaa8ee19-b7b6-4694-a57c-5a871c06bf79'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:53 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] Delete snapshot completed successfully. Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ea8cc48f-6c87-4d3a-9eb4-e776a36a1531 tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-ecd341f3-141e-4afc-8285-891e42b78984-delete_snapshot" released by "delete_snapshot" :: held 6.296s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:53 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a Jul 04 00:01:53 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] Acquiring lock "cinder-a62363fd-8cb8-49f0-afd6-628ab1f13c73-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "cinder-7043d655-179f-4ec4-a01f-916f273969c4-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-a62363fd-8cb8-49f0-afd6-628ab1f13c73-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-7043d655-179f-4ec4-a01f-916f273969c4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] Acquiring lock "cinder-quobyte-a62363fd-8cb8-49f0-afd6-628ab1f13c73" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "cinder-quobyte-7043d655-179f-4ec4-a01f-916f273969c4" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-quobyte-7043d655-179f-4ec4-a01f-916f273969c4" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-quobyte-a62363fd-8cb8-49f0-afd6-628ab1f13c73" acquired by "delete_volume" :: waited 0.042s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9545d14b-8756-49e5-a90e-0a71f1dc704a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7043d655-179f-4ec4-a01f-916f273969c4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa82d97d-93fc-4fce-ad96-0f1563ffc722]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:54 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.820s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:54 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:01:54 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Deleted volume successfully. Jul 04 00:01:54 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7043d655-179f-4ec4-a01f-916f273969c4 Jul 04 00:01:54 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:54 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73 Jul 04 00:01:54 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3f98014a-21c7-40c5-8d63-f832605130c4 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-87749398-e306-43c4-80b0-9d71fe031888-delete_volume" released by "delete_volume" :: held 5.187s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:54 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a" returned: 0 in 1.144s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:54 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4c65211-dc51-4e70-a693-418e7f059c3d {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 04 00:01:54 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Converted 1024.00 MB image at 180.71 MB/s Jul 04 00:01:54 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4c65211-dc51-4e70-a693-418e7f059c3d is being set with open permissions: ugo+rw Jul 04 00:01:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4c65211-dc51-4e70-a693-418e7f059c3d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:54 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4c65211-dc51-4e70-a693-418e7f059c3d Jul 04 00:01:54 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:54 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7043d655-179f-4ec4-a01f-916f273969c4" returned: 0 in 0.829s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7043d655-179f-4ec4-a01f-916f273969c4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:54 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7043d655-179f-4ec4-a01f-916f273969c4 Jul 04 00:01:54 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:54 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73" returned: 0 in 0.860s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:54 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73 Jul 04 00:01:54 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:55 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4c65211-dc51-4e70-a693-418e7f059c3d" returned: 0 in 0.723s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-f4c65211-dc51-4e70-a693-418e7f059c3d" released by "_copy_volume_from_snapshot" :: held 9.344s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-98944fc7-4bf0-40b5-810e-8c20309d5e29-f4c65211-dc51-4e70-a693-418e7f059c3d" released by "_create_volume_from_snapshot" :: held 9.401s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.445s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.368s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1546602327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d798f2-ce28-4d97-9d3a-0290bd3032f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8bcd0e2b134119b1f659465aa20641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:41Z,use_quota=True,user_id='4d079cbf15874ed2a0ccaaa3d285b1ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Creating volume 96d798f2-ce28-4d97-9d3a-0290bd3032f8 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:01:55 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:55 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 1073741824 Jul 04 00:01:55 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c45940-b5be-49ef-944d-86b808a5a18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c65211-dc51-4e70-a693-418e7f059c3d', 'volume_size': 1, 'snapshot_id': '98944fc7-4bf0-40b5-810e-8c20309d5e29'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713d0684-811e-461b-82b6-a5fab428cfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:55 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Volume volume-f4c65211-dc51-4e70-a693-418e7f059c3d (f4c65211-dc51-4e70-a693-418e7f059c3d): created successfully Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713d0684-811e-461b-82b6-a5fab428cfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Flow 'volume_create_manager' (ee72436d-9594-4fd1-a0c4-e92c8f1de89e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0703d511-0f97-450c-92e7-6d5d5821ecea tempest-VolumesSnapshotTestJSON-832763818 None] Created volume successfully. Jul 04 00:01:55 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7043d655-179f-4ec4-a01f-916f273969c4" returned: 0 in 0.772s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-quobyte-7043d655-179f-4ec4-a01f-916f273969c4" released by "delete_volume" :: held 1.673s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Created reservations ['de9e5ba8-d5d1-400f-a7d1-a3eb607b1695', '426f1332-b0f4-413d-a094-23fdc7ab480f', '4c9e0119-f825-4b12-bef6-bd5dd31c3916', '057245c4-71b7-42f7-b8fc-9a4a6408c8e7'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:55 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a62363fd-8cb8-49f0-afd6-628ab1f13c73" returned: 0 in 0.846s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-quobyte-a62363fd-8cb8-49f0-afd6-628ab1f13c73" released by "delete_volume" :: held 1.779s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:55 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:01:55 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] Created reservations ['4446da14-2253-4886-b7fe-a42bbf95766f', '62de7a58-137e-460b-abb5-eb9f38e2d724', '817ab7ad-5ed3-4110-81ba-84caa6df4d84', '88547f1a-7232-4674-9b59-908078a73fe7'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:55 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:01:55 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "cinder-45da9889-1153-4a45-9213-ce256ae0324c-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-45da9889-1153-4a45-9213-ce256ae0324c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "cinder-quobyte-45da9889-1153-4a45-9213-ce256ae0324c" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-quobyte-45da9889-1153-4a45-9213-ce256ae0324c" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:56 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f119a8-0300-417a-ac6f-9eb56d7cae92]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45da9889-1153-4a45-9213-ce256ae0324c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:56 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 1073741824" returned: 0 in 1.189s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:56 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 Jul 04 00:01:56 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-f4c65211-dc51-4e70-a693-418e7f059c3d-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:56 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45da9889-1153-4a45-9213-ce256ae0324c Jul 04 00:01:56 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-f4c65211-dc51-4e70-a693-418e7f059c3d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-quobyte-f4c65211-dc51-4e70-a693-418e7f059c3d" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-f4c65211-dc51-4e70-a693-418e7f059c3d" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:56 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e66d6aa-af2b-4e2b-9775-bbbcb3a3bfbe]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4c65211-dc51-4e70-a693-418e7f059c3d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:56 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.054s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:56 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:01:56 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] Deleted volume successfully. Jul 04 00:01:56 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.261s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:56 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:01:56 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Deleted volume successfully. Jul 04 00:01:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-85bb2288-61ee-43fe-b8ef-7964e951e53c tempest-VolumesSnapshotListTestJSON-1668822991 None] Lock "cinder-a62363fd-8cb8-49f0-afd6-628ab1f13c73-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:57 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4c65211-dc51-4e70-a693-418e7f059c3d Jul 04 00:01:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dc80c39e-92ad-4a42-8f5a-10f69fa87e79 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-7043d655-179f-4ec4-a01f-916f273969c4-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:57 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:57 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8" returned: 0 in 1.122s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] <== create_volume: return (2397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:01:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.401s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:57 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45da9889-1153-4a45-9213-ce256ae0324c" returned: 0 in 1.295s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45da9889-1153-4a45-9213-ce256ae0324c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:57 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45da9889-1153-4a45-9213-ce256ae0324c Jul 04 00:01:57 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16babf80-3b33-4d63-beed-4bdae8a43302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe58bdc2-45bb-4098-93d8-78c40e0b34eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:01:57 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Volume volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 (96d798f2-ce28-4d97-9d3a-0290bd3032f8): created successfully Jul 04 00:01:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe58bdc2-45bb-4098-93d8-78c40e0b34eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:01:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Flow 'volume_create_manager' (aa2cb289-c504-4d5e-a447-8f108cb92f77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:01:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9ba3b5ed-b489-4234-bf6a-80a3e53f3a64 tempest-VolumesDeleteCascade-1265150594 None] Created volume successfully. Jul 04 00:01:58 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4c65211-dc51-4e70-a693-418e7f059c3d" returned: 0 in 1.213s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4c65211-dc51-4e70-a693-418e7f059c3d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:58 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4c65211-dc51-4e70-a693-418e7f059c3d Jul 04 00:01:58 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:58 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-45da9889-1153-4a45-9213-ce256ae0324c" returned: 0 in 0.778s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-quobyte-45da9889-1153-4a45-9213-ce256ae0324c" released by "delete_volume" :: held 2.160s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:58 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Created reservations ['35f8583e-84c8-4a65-97f9-bdcf0461b252', '1ce5e6b5-079e-4eae-84ef-fcfa3cd0d57c', '0d70a06b-d5bd-4e5f-8253-8c71c6dec7cd', 'bee53e20-beac-481a-bfd1-740c72c0fad7'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-54d76d86-c2e2-4d6b-8c11-7af45f5a1559 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-54d76d86-c2e2-4d6b-8c11-7af45f5a1559 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-54d76d86-c2e2-4d6b-8c11-7af45f5a1559 tempest-VolumesDeleteCascade-1265150594 None] Creating offline snapshot 526a7c2d-4fb1-4be5-bf64-3190501d42dd of volume 96d798f2-ce28-4d97-9d3a-0290bd3032f8 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:01:58 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ed975c-7b23-4b8e-adcd-6a38320eafb2]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-54d76d86-c2e2-4d6b-8c11-7af45f5a1559 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:58 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:01:58 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 Jul 04 00:01:58 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:58 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:58 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4c65211-dc51-4e70-a693-418e7f059c3d" returned: 0 in 0.810s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-f4c65211-dc51-4e70-a693-418e7f059c3d" released by "delete_volume" :: held 2.092s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:58 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] Created reservations ['891d4da9-7a2f-47e9-92f1-f47cac826087', 'e5041dd8-58fa-4cc5-bfb2-16df26fe7638', '5379a826-9b11-4863-9ad6-ce0d56681b29', 'f35b3e04-dea8-4848-81dd-75414731cea5'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:01:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:01:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:01:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:01:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:01:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:01:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:59 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:01:59 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:59 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.897s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:59 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:01:59 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Deleted volume successfully. Jul 04 00:01:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "cinder-a67122b5-bab7-44fd-9fd8-f8af9efb3149-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a23244eb-5882-42fb-bf4a-9c4ac4ed6e08 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-45da9889-1153-4a45-9213-ce256ae0324c-delete_volume" released by "delete_volume" :: held 3.481s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:01:59 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-a67122b5-bab7-44fd-9fd8-f8af9efb3149-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-54d76d86-c2e2-4d6b-8c11-7af45f5a1559 tempest-VolumesDeleteCascade-1265150594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8" returned: 0 in 1.086s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:01:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-54d76d86-c2e2-4d6b-8c11-7af45f5a1559 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:59 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd 1G Jul 04 00:01:59 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "cinder-quobyte-a67122b5-bab7-44fd-9fd8-f8af9efb3149" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:01:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-quobyte-a67122b5-bab7-44fd-9fd8-f8af9efb3149" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:01:59 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd27bde-718c-4633-bed4-09d28f3ee672]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:01:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a67122b5-bab7-44fd-9fd8-f8af9efb3149 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:01:59 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a67122b5-bab7-44fd-9fd8-f8af9efb3149 Jul 04 00:01:59 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:01:59 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Jul 04 00:01:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.892s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:00 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:02:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] Deleted volume successfully. Jul 04 00:02:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6f9f9203-430d-4de2-a68f-8d5b9c0e6d28 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-f4c65211-dc51-4e70-a693-418e7f059c3d-delete_volume" released by "delete_volume" :: held 3.394s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-98944fc7-4bf0-40b5-810e-8c20309d5e29-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-98944fc7-4bf0-40b5-810e-8c20309d5e29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-quobyte-b8b137cc-893e-4ee8-bd46-bf0289fb170a" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-b8b137cc-893e-4ee8-bd46-bf0289fb170a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-quobyte-98944fc7-4bf0-40b5-810e-8c20309d5e29" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-98944fc7-4bf0-40b5-810e-8c20309d5e29" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] Deleting offline snapshot 98944fc7-4bf0-40b5-810e-8c20309d5e29 of volume b8b137cc-893e-4ee8-bd46-bf0289fb170a {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:02:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] snapshot_file for this snap is: volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:02:00 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f96bf4-a443-4394-8df0-bbe80b7d7565]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:00 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29 Jul 04 00:02:00 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:00 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-54d76d86-c2e2-4d6b-8c11-7af45f5a1559 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd 1G" returned: 0 in 1.122s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-54d76d86-c2e2-4d6b-8c11-7af45f5a1559 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:00 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a67122b5-bab7-44fd-9fd8-f8af9efb3149" returned: 0 in 1.099s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a67122b5-bab7-44fd-9fd8-f8af9efb3149 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:00 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd Jul 04 00:02:00 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:00 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a67122b5-bab7-44fd-9fd8-f8af9efb3149 Jul 04 00:02:00 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:01 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29" returned: 0 in 1.117s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:02:01 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[556eb5f5-ce51-4abc-924b-25efc6e79635]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:01 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a Jul 04 00:02:01 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:01 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-54d76d86-c2e2-4d6b-8c11-7af45f5a1559 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd" returned: 0 in 0.982s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:01 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-54d76d86-c2e2-4d6b-8c11-7af45f5a1559 tempest-VolumesDeleteCascade-1265150594 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd is being set with open permissions: ugo+rw Jul 04 00:02:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-54d76d86-c2e2-4d6b-8c11-7af45f5a1559 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:01 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a67122b5-bab7-44fd-9fd8-f8af9efb3149" returned: 0 in 0.893s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-quobyte-a67122b5-bab7-44fd-9fd8-f8af9efb3149" released by "delete_volume" :: held 2.055s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:01 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd Jul 04 00:02:01 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:01 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Created reservations ['0440e962-1587-413b-b629-0ff8c4cba76c', 'b65d4159-41f3-4bc7-ac9f-4379bbdd433b', '4a8665c7-052b-4dd3-ac4a-e556ff45247f', '15b0e13b-b949-45e0-928f-63d662c76ce2'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:02:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:02:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:02:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:02 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:02:02 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "cinder-6f994995-e00e-481f-b97a-d83c653bf246-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-6f994995-e00e-481f-b97a-d83c653bf246-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "cinder-quobyte-6f994995-e00e-481f-b97a-d83c653bf246" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-quobyte-6f994995-e00e-481f-b97a-d83c653bf246" acquired by "delete_volume" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:02 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c2ce1d-5030-459f-bcf9-bef7a1da6774]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6f994995-e00e-481f-b97a-d83c653bf246 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:02 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6f994995-e00e-481f-b97a-d83c653bf246 Jul 04 00:02:02 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:02 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a" returned: 0 in 1.106s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:02 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29 Jul 04 00:02:02 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:02 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-54d76d86-c2e2-4d6b-8c11-7af45f5a1559 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd" returned: 0 in 1.025s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-54d76d86-c2e2-4d6b-8c11-7af45f5a1559 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:02 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.info Jul 04 00:02:02 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:03 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.092s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:03 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:02:03 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Deleted volume successfully. Jul 04 00:02:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6ba5d343-db8f-4bc8-b957-48af56982545 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-a67122b5-bab7-44fd-9fd8-f8af9efb3149-delete_volume" released by "delete_volume" :: held 3.483s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:03 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6f994995-e00e-481f-b97a-d83c653bf246" returned: 0 in 1.189s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6f994995-e00e-481f-b97a-d83c653bf246 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:03 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:03 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6f994995-e00e-481f-b97a-d83c653bf246 Jul 04 00:02:03 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29" returned: 0 in 0.955s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:03 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29 Jul 04 00:02:03 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:03 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-54d76d86-c2e2-4d6b-8c11-7af45f5a1559 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.info" returned: 0 in 0.956s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:03 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-54d76d86-c2e2-4d6b-8c11-7af45f5a1559 tempest-VolumesDeleteCascade-1265150594 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.info is being set with open permissions: ugo+rw Jul 04 00:02:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-54d76d86-c2e2-4d6b-8c11-7af45f5a1559 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:03 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.info Jul 04 00:02:03 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:04 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6f994995-e00e-481f-b97a-d83c653bf246" returned: 0 in 0.812s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-quobyte-6f994995-e00e-481f-b97a-d83c653bf246" released by "delete_volume" :: held 2.066s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:04 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Created reservations ['af5f57a3-efed-4043-bbc7-8bc03e0655ce', '1bc1cd78-3793-49b1-98b0-707b966ff54a', 'ae6acccb-c88c-4803-a945-462d2a4c01f2', '4c9d999e-9b95-4e95-a368-a4d352ce1a93'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:02:04 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a.98944fc7-4bf0-40b5-810e-8c20309d5e29" returned: 0 in 0.956s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:02:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:02:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-98944fc7-4bf0-40b5-810e-8c20309d5e29" released by "_delete_snapshot" :: held 4.289s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-b8b137cc-893e-4ee8-bd46-bf0289fb170a" released by "delete_snapshot" :: held 4.330s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:04 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:02:04 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:04 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] Created reservations ['0dd4ff65-6022-4078-a251-b421b5bfe584', '15035690-7b1f-4554-bcfe-a6ff773cea81', '167cca02-3f5a-4348-ab51-dc1affc7a3b9', '6caec4bf-2b8c-4ba7-b3d8-d7ea43f1a49a'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:02:04 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-54d76d86-c2e2-4d6b-8c11-7af45f5a1559 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.info" returned: 0 in 0.842s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-54d76d86-c2e2-4d6b-8c11-7af45f5a1559 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.143s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-54d76d86-c2e2-4d6b-8c11-7af45f5a1559 tempest-VolumesDeleteCascade-1265150594 None] Create snapshot completed successfully Jul 04 00:02:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] Delete snapshot completed successfully. Jul 04 00:02:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-58bfcb2f-6ff4-4ed8-a012-1e863a9f3891 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-98944fc7-4bf0-40b5-810e-8c20309d5e29-delete_snapshot" released by "delete_snapshot" :: held 4.556s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:05 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.809s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:02:05 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Deleted volume successfully. Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d52e53c7-cd86-4480-aa97-b595c00d2cd6 tempest-CreateVolumesFromSourceVolumeTest-792226135 None] Lock "cinder-6f994995-e00e-481f-b97a-d83c653bf246-delete_volume" released by "delete_volume" :: held 3.228s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-b8b137cc-893e-4ee8-bd46-bf0289fb170a-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-b8b137cc-893e-4ee8-bd46-bf0289fb170a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Flow 'volume_create_manager' (821dc706-0dda-4621-b2ba-467e6c03f799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e93d61c-9ac7-4809-bdce-51be014d5bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e93d61c-9ac7-4809-bdce-51be014d5bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-508011970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9dc963a-bff9-48e8-9f88-e42cf409b340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8bcd0e2b134119b1f659465aa20641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=526a7c2d-4fb1-4be5-bf64-3190501d42dd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:06Z,use_quota=True,user_id='4d079cbf15874ed2a0ccaaa3d285b1ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daec7566-d100-47bf-bbcf-4559b92f9486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daec7566-d100-47bf-bbcf-4559b92f9486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5135d3c3-8227-4183-a863-b2a004bcb5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5135d3c3-8227-4183-a863-b2a004bcb5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c9dc963a-bff9-48e8-9f88-e42cf409b340', 'volume_name': 'volume-c9dc963a-bff9-48e8-9f88-e42cf409b340', 'volume_size': 1, 'snapshot_id': '526a7c2d-4fb1-4be5-bf64-3190501d42dd'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a098a7d8-73b6-4c21-9bd2-65cfd82083a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a098a7d8-73b6-4c21-9bd2-65cfd82083a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4171f1c-b706-46b0-9464-23f2771ea27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:05 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Volume c9dc963a-bff9-48e8-9f88-e42cf409b340: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c9dc963a-bff9-48e8-9f88-e42cf409b340', 'volume_size': 1, 'snapshot_id': '526a7c2d-4fb1-4be5-bf64-3190501d42dd'} Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-quobyte-b8b137cc-893e-4ee8-bd46-bf0289fb170a" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "cinder-quobyte-526a7c2d-4fb1-4be5-bf64-3190501d42dd-c9dc963a-bff9-48e8-9f88-e42cf409b340" by "_create_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-b8b137cc-893e-4ee8-bd46-bf0289fb170a" acquired by "delete_volume" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-526a7c2d-4fb1-4be5-bf64-3190501d42dd-c9dc963a-bff9-48e8-9f88-e42cf409b340" acquired by "_create_volume_from_snapshot" :: waited 0.066s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Creating volume c9dc963a-bff9-48e8-9f88-e42cf409b340 from snapshot 526a7c2d-4fb1-4be5-bf64-3190501d42dd {{(pid=86676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "cinder-quobyte-c9dc963a-bff9-48e8-9f88-e42cf409b340" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0f36f5-4d9d-4146-9232-322fe7e79b44]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-c9dc963a-bff9-48e8-9f88-e42cf409b340" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] snapshot: 526a7c2d-4fb1-4be5-bf64-3190501d42dd, volume: c9dc963a-bff9-48e8-9f88-e42cf409b340, {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[314e79cc-90fe-4934-9f02-3a6bea220cea]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:06 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a Jul 04 00:02:06 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:06 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd Jul 04 00:02:06 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:07 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd" returned: 0 in 1.141s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:02:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 04 00:02:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 04 00:02:07 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a" returned: 0 in 1.277s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:07 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2f135b-22f4-4760-b8bf-9ffff9907374]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:07 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a Jul 04 00:02:07 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:07 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 Jul 04 00:02:07 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:08 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8b137cc-893e-4ee8-bd46-bf0289fb170a" returned: 0 in 1.211s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-b8b137cc-893e-4ee8-bd46-bf0289fb170a" released by "delete_volume" :: held 2.592s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:08 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8" returned: 0 in 1.314s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:08 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Path /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c9dc963a-bff9-48e8-9f88-e42cf409b340 not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 04 00:02:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c9dc963a-bff9-48e8-9f88-e42cf409b340 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:08 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] Created reservations ['383a463e-d5b7-4265-8ac1-cddfa4b91a63', '8b097361-9ad3-44c6-bea9-d31179f9fdde', '5e244b9f-f850-4824-9729-63b809e9753e', 'df8f7d59-4090-490d-8e91-7530b7419a88'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:02:08 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c9dc963a-bff9-48e8-9f88-e42cf409b340 Jul 04 00:02:08 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:02:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:02:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:08 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:02:08 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "cinder-quobyte-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:09 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cf0d38-fa03-4d22-85cc-116277d6729d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:09 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc Jul 04 00:02:09 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:10 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.274s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:10 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:02:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] Deleted volume successfully. Jul 04 00:02:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6406684b-7557-4319-8902-570c316540c8 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-b8b137cc-893e-4ee8-bd46-bf0289fb170a-delete_volume" released by "delete_volume" :: held 4.464s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:11 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc" returned: 0 in 1.648s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:11 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc Jul 04 00:02:11 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:13 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc" returned: 0 in 2.110s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-quobyte-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc" released by "delete_volume" :: held 3.907s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:13 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] Created reservations ['7076ec43-835f-468f-bfbd-80612292fbc3', 'a2737f9c-7a7b-4fcc-bbad-f523d018626d', '8ea3cbef-3c3c-4a38-aaf6-5811e19cc2c2', '3e08ab88-adf5-4ceb-a323-c4dd8de73ee1'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:02:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:02:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:02:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:13 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:02:13 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:15 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.914s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:15 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:02:15 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] Deleted volume successfully. Jul 04 00:02:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-42b5caf5-72a3-4240-98ac-d1f6d87922a6 tempest-VolumesSnapshotTestJSON-832763818 None] Lock "cinder-1ee0e061-a4cc-4f68-9df2-e79e08cd08bc-delete_volume" released by "delete_volume" :: held 6.368s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:15 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c9dc963a-bff9-48e8-9f88-e42cf409b340" returned: 0 in 7.356s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:16 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0e3ab1-affd-4bfa-b29f-56edff5f2f9c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:16 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 Jul 04 00:02:16 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:17 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8" returned: 0 in 1.411s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:17 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8, size 1024.00 MB, duration 7.36 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c9dc963a-bff9-48e8-9f88-e42cf409b340 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 04 00:02:17 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Converted 1024.00 MB image at 139.18 MB/s Jul 04 00:02:17 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c9dc963a-bff9-48e8-9f88-e42cf409b340 is being set with open permissions: ugo+rw Jul 04 00:02:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c9dc963a-bff9-48e8-9f88-e42cf409b340 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:17 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c9dc963a-bff9-48e8-9f88-e42cf409b340 Jul 04 00:02:17 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:17 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:02:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Flow 'volume_create_manager' (f1efc870-f093-4bbd-95b4-ed1ab9421f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:02:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926e602d-9033-4a93-a21e-99453952f25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926e602d-9033-4a93-a21e-99453952f25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55b8121-fb89-4852-9ece-a2f577e59aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc927f515c6a4b1094aa0a81c0a2be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:18Z,use_quota=True,user_id='da7760da09e7431db94facd26114adee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe9d688-708c-48e8-939c-938ca1d781ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe9d688-708c-48e8-939c-938ca1d781ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f5ab36-848e-4174-9add-37697061944d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:17 devstack cinder-volume[86676]: DEBUG cinder.image.glance [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Creating Keystone auth plugin from conf {{(pid=86676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 04 00:02:18 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c9dc963a-bff9-48e8-9f88-e42cf409b340" returned: 0 in 0.813s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-c9dc963a-bff9-48e8-9f88-e42cf409b340" released by "_copy_volume_from_snapshot" :: held 12.201s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-526a7c2d-4fb1-4be5-bf64-3190501d42dd-c9dc963a-bff9-48e8-9f88-e42cf409b340" released by "_create_volume_from_snapshot" :: held 12.274s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.341s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f5ab36-848e-4174-9add-37697061944d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b55b8121-fb89-4852-9ece-a2f577e59aa8', 'volume_name': 'volume-b55b8121-fb89-4852-9ece-a2f577e59aa8', 'volume_size': 1, 'image_id': '6289fcf2-f39d-40e0-89c3-52c16ada1a78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6289fcf2-f39d-40e0-89c3-52c16ada1a78', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a848398c075ce524e10508cce5955bbb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cc927f515c6a4b1094aa0a81c0a2be54', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e3e82ed1afad1fdf8429c668308ea9b19de52b01c6e4d965260f30007b433d3b503f21bf554fb889825f9fbcad4506fd8a7c351e2ee4f415cd28a79d726f23f6', 'id': '6289fcf2-f39d-40e0-89c3-52c16ada1a78', 'created_at': datetime.datetime(2026, 7, 3, 22, 2, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 2, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6289fcf2-f39d-40e0-89c3-52c16ada1a78/file', 'properties': {}}, 'image_service': }' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd380c58-4284-407c-a17a-01904c38de01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd380c58-4284-407c-a17a-01904c38de01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cbe81f-26c3-4d6f-b4ab-bdc28765659d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:18 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Volume b55b8121-fb89-4852-9ece-a2f577e59aa8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b55b8121-fb89-4852-9ece-a2f577e59aa8', 'volume_size': 1, 'image_id': '6289fcf2-f39d-40e0-89c3-52c16ada1a78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6289fcf2-f39d-40e0-89c3-52c16ada1a78', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a848398c075ce524e10508cce5955bbb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cc927f515c6a4b1094aa0a81c0a2be54', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e3e82ed1afad1fdf8429c668308ea9b19de52b01c6e4d965260f30007b433d3b503f21bf554fb889825f9fbcad4506fd8a7c351e2ee4f415cd28a79d726f23f6', 'id': '6289fcf2-f39d-40e0-89c3-52c16ada1a78', 'created_at': datetime.datetime(2026, 7, 3, 22, 2, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 2, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6289fcf2-f39d-40e0-89c3-52c16ada1a78/file', 'properties': {}}, 'image_service': } Jul 04 00:02:18 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Trying to clone b55b8121-fb89-4852-9ece-a2f577e59aa8 from image 6289fcf2-f39d-40e0-89c3-52c16ada1a78 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6289fcf2-f39d-40e0-89c3-52c16ada1a78', 'metadata': {}}]). {{(pid=86676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 04 00:02:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4171f1c-b706-46b0-9464-23f2771ea27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9dc963a-bff9-48e8-9f88-e42cf409b340', 'volume_size': 1, 'snapshot_id': '526a7c2d-4fb1-4be5-bf64-3190501d42dd'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b46581-41af-4115-8889-353dd5af9d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:18 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Volume volume-c9dc963a-bff9-48e8-9f88-e42cf409b340 (c9dc963a-bff9-48e8-9f88-e42cf409b340): created successfully Jul 04 00:02:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b46581-41af-4115-8889-353dd5af9d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Flow 'volume_create_manager' (821dc706-0dda-4621-b2ba-467e6c03f799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:02:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a81e7eff-dbe1-4ce4-950d-32cbc7b54a24 tempest-VolumesDeleteCascade-1265150594 None] Created volume successfully. Jul 04 00:02:18 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 04 00:02:18 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Image download 0.00 MB at 0.00 MB/s Jul 04 00:02:18 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[098b3794-43b9-4f52-a403-71934674d618]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:18 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD Jul 04 00:02:18 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "cinder-96d798f2-ce28-4d97-9d3a-0290bd3032f8-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-96d798f2-ce28-4d97-9d3a-0290bd3032f8-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Performing cascade delete. {{(pid=86676) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Jul 04 00:02:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "cinder-526a7c2d-4fb1-4be5-bf64-3190501d42dd-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-526a7c2d-4fb1-4be5-bf64-3190501d42dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "cinder-quobyte-96d798f2-ce28-4d97-9d3a-0290bd3032f8" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-96d798f2-ce28-4d97-9d3a-0290bd3032f8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "cinder-quobyte-526a7c2d-4fb1-4be5-bf64-3190501d42dd" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-526a7c2d-4fb1-4be5-bf64-3190501d42dd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Deleting offline snapshot 526a7c2d-4fb1-4be5-bf64-3190501d42dd of volume 96d798f2-ce28-4d97-9d3a-0290bd3032f8 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:02:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] snapshot_file for this snap is: volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:02:19 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD" returned: 0 in 1.064s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:19 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc334496-09f5-4cb6-8587-21755c62fb3d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:19 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD Jul 04 00:02:19 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:19 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd Jul 04 00:02:19 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:20 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD" returned: 1 in 0.969s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:02:20 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Temporary image 6289fcf2-f39d-40e0-89c3-52c16ada1a78 is fetched for user da7760da09e7431db94facd26114adee. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 04 00:02:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd" returned: 0 in 1.198s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:02:20 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:20 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23bfcde-5447-47a6-98c5-769d3ccc6fef]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:20 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3d846e-c8cc-4588-8976-cd449cff4d7a]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:21 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 Jul 04 00:02:21 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:21 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD Jul 04 00:02:21 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:22 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8" returned: 0 in 1.200s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:22 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd Jul 04 00:02:22 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:22 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD" returned: 0 in 1.187s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:22 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD Jul 04 00:02:22 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:23 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd" returned: 0 in 0.918s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:23 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd Jul 04 00:02:23 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:23 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD" returned: 1 in 1.091s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:02:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55b8121-fb89-4852-9ece-a2f577e59aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc927f515c6a4b1094aa0a81c0a2be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:18Z,use_quota=True,user_id='da7760da09e7431db94facd26114adee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:02:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Creating volume b55b8121-fb89-4852-9ece-a2f577e59aa8 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:02:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:02:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:02:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:02:23 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:02:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:23 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 1073741824 Jul 04 00:02:23 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:24 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8.526a7c2d-4fb1-4be5-bf64-3190501d42dd" returned: 0 in 1.084s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-526a7c2d-4fb1-4be5-bf64-3190501d42dd" released by "_delete_snapshot" :: held 4.563s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-96d798f2-ce28-4d97-9d3a-0290bd3032f8" released by "delete_snapshot" :: held 4.601s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:24 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Created reservations ['1af72776-19a6-4365-b341-11276dbb0f19', 'faa16a95-0056-4e72-b1d6-28608cf0ad75', '77672364-2771-454e-8af0-59b70286c8d9', '7acb5930-9418-4674-b285-bab3c4f4f618'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:02:24 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Delete snapshot completed successfully. Jul 04 00:02:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-526a7c2d-4fb1-4be5-bf64-3190501d42dd-delete_snapshot" released by "delete_snapshot" :: held 4.843s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Snapshots deleted, issuing volume delete {{(pid=86676) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Jul 04 00:02:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "cinder-quobyte-96d798f2-ce28-4d97-9d3a-0290bd3032f8" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-96d798f2-ce28-4d97-9d3a-0290bd3032f8" acquired by "delete_volume" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:24 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d1c6e4-172a-46c1-9dac-352c20dd623a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:24 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 1073741824" returned: 0 in 1.361s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:24 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 Jul 04 00:02:24 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:24 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 Jul 04 00:02:24 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:25 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8" returned: 0 in 1.119s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:25 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8 Jul 04 00:02:25 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8" returned: 0 in 0.953s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:25 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] <== create_volume: return (2401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:02:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.425s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:25 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Attempting download of 6289fcf2-f39d-40e0-89c3-52c16ada1a78 ((None, [{'url': 'file:///opt/stack/data/glance/images/6289fcf2-f39d-40e0-89c3-52c16ada1a78', 'metadata': {}}])) to volume b55b8121-fb89-4852-9ece-a2f577e59aa8. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 04 00:02:25 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f948c9a6-903c-41ce-ac0e-723e88b2dd96]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6289fcf2-f39d-40e0-89c3-52c16ada1a78_2jbznsqk {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:26 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6289fcf2-f39d-40e0-89c3-52c16ada1a78_2jbznsqk Jul 04 00:02:26 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:26 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-96d798f2-ce28-4d97-9d3a-0290bd3032f8" returned: 0 in 1.029s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-96d798f2-ce28-4d97-9d3a-0290bd3032f8" released by "delete_volume" :: held 2.231s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:26 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Created reservations ['7808fb9d-0bc6-445d-beda-d038f647cdc2', 'b1be55ba-d83d-4829-86b5-92984f2f3df4', '050ac474-f58b-41e8-9dad-4e2511647b42', 'd4228987-8a38-4313-a037-d03686d88856'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:02:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:02:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:02:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:26 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6289fcf2-f39d-40e0-89c3-52c16ada1a78_2jbznsqk" returned: 0 in 1.036s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6289fcf2-f39d-40e0-89c3-52c16ada1a78_2jbznsqk {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:26 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:02:26 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:27 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6289fcf2-f39d-40e0-89c3-52c16ada1a78_2jbznsqk Jul 04 00:02:27 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "cinder-c9dc963a-bff9-48e8-9f88-e42cf409b340-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-c9dc963a-bff9-48e8-9f88-e42cf409b340-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:27 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:27 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=162,cinder:SELECT=126,cinder:DELETE=9,cinder:INSERT=38 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:02:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.801s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:27 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:02:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Deleted volume successfully. Jul 04 00:02:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eccf2657-5c95-4a61-ac18-9df897de806b tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-96d798f2-ce28-4d97-9d3a-0290bd3032f8-delete_volume" released by "delete_volume" :: held 8.245s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "cinder-quobyte-c9dc963a-bff9-48e8-9f88-e42cf409b340" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-c9dc963a-bff9-48e8-9f88-e42cf409b340" acquired by "delete_volume" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:27 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[51233a33-6e39-443d-96ea-4ae798b97eb8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c9dc963a-bff9-48e8-9f88-e42cf409b340 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:27 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c9dc963a-bff9-48e8-9f88-e42cf409b340 Jul 04 00:02:27 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:28 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6289fcf2-f39d-40e0-89c3-52c16ada1a78_2jbznsqk" returned: 1 in 1.119s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6289fcf2-f39d-40e0-89c3-52c16ada1a78_2jbznsqk' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:02:28 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea0fe6c-3307-4ba2-a683-950d38e29663]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:28 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD Jul 04 00:02:28 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:28 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c9dc963a-bff9-48e8-9f88-e42cf409b340" returned: 0 in 1.130s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c9dc963a-bff9-48e8-9f88-e42cf409b340 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:28 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c9dc963a-bff9-48e8-9f88-e42cf409b340 Jul 04 00:02:28 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:28 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD" returned: 0 in 0.960s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:29 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD Jul 04 00:02:29 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:29 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c9dc963a-bff9-48e8-9f88-e42cf409b340" returned: 0 in 0.812s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-quobyte-c9dc963a-bff9-48e8-9f88-e42cf409b340" released by "delete_volume" :: held 1.995s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:29 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] Created reservations ['0f2351c0-8995-4d9e-8752-9e22739bbf1d', '8f60feaa-6bd6-47c8-bf9a-03132d5f550b', 'fc7efa9a-ceff-43a4-9304-22f9954e219a', '69081d45-3bf1-4217-97ce-7d148c817a7d'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:02:29 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD" returned: 1 in 0.945s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:02:29 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] 6289fcf2-f39d-40e0-89c3-52c16ada1a78 was raw, converting to raw {{(pid=86676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 04 00:02:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:29 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 Jul 04 00:02:29 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:02:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:02:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:30 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:02:30 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:30 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8" returned: 0 in 0.987s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:30 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6289fcf2-f39d-40e0-89c3-52c16ada1a78_wewo0n8pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 04 00:02:30 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Converted 0.00 MB image at 0.00 MB/s Jul 04 00:02:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:30 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.891s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:30 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:02:31 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] Deleted volume successfully. Jul 04 00:02:31 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 1G Jul 04 00:02:31 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-34497372-0453-4a24-b920-db2ac9ed721d tempest-VolumesDeleteCascade-1265150594 None] Lock "cinder-c9dc963a-bff9-48e8-9f88-e42cf409b340-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:32 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 1G" returned: 0 in 1.138s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:32 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[da70aa17-f510-4557-9b18-53a4b6729ec8]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:32 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 Jul 04 00:02:32 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:33 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8" returned: 0 in 1.157s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:02:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:02:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:02:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:33 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 Jul 04 00:02:33 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:33 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:02:33 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:34 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.301s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:02:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:02:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:02:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:02:34 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8" returned: 1 in 1.478s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:02:34 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Downloaded image 6289fcf2-f39d-40e0-89c3-52c16ada1a78 ((None, [{'url': 'file:///opt/stack/data/glance/images/6289fcf2-f39d-40e0-89c3-52c16ada1a78', 'metadata': {}}])) to volume b55b8121-fb89-4852-9ece-a2f577e59aa8 successfully. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 04 00:02:34 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Temporary image 6289fcf2-f39d-40e0-89c3-52c16ada1a78 for user da7760da09e7431db94facd26114adee is deleted. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 04 00:02:34 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Marking volume b55b8121-fb89-4852-9ece-a2f577e59aa8 as bootable. {{(pid=86676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 04 00:02:34 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Copying metadata from image 6289fcf2-f39d-40e0-89c3-52c16ada1a78 to b55b8121-fb89-4852-9ece-a2f577e59aa8. {{(pid=86676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 04 00:02:34 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Creating volume glance metadata for volume b55b8121-fb89-4852-9ece-a2f577e59aa8 backed by image 6289fcf2-f39d-40e0-89c3-52c16ada1a78 with: {'image_id': '6289fcf2-f39d-40e0-89c3-52c16ada1a78', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a848398c075ce524e10508cce5955bbb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 04 00:02:34 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=116,cinder:INSERT=50,cinder:UPDATE=166,cinder:DELETE=16 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cbe81f-26c3-4d6f-b4ab-bdc28765659d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b55b8121-fb89-4852-9ece-a2f577e59aa8', 'volume_size': 1, 'image_id': '6289fcf2-f39d-40e0-89c3-52c16ada1a78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6289fcf2-f39d-40e0-89c3-52c16ada1a78', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a848398c075ce524e10508cce5955bbb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cc927f515c6a4b1094aa0a81c0a2be54', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e3e82ed1afad1fdf8429c668308ea9b19de52b01c6e4d965260f30007b433d3b503f21bf554fb889825f9fbcad4506fd8a7c351e2ee4f415cd28a79d726f23f6', 'id': '6289fcf2-f39d-40e0-89c3-52c16ada1a78', 'created_at': datetime.datetime(2026, 7, 3, 22, 2, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 2, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6289fcf2-f39d-40e0-89c3-52c16ada1a78/file', 'properties': {}}, 'image_service': }' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a5a154-b2f8-42da-b6e1-fb8d8c84fb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:35 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Volume volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 (b55b8121-fb89-4852-9ece-a2f577e59aa8): created successfully Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a5a154-b2f8-42da-b6e1-fb8d8c84fb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Flow 'volume_create_manager' (f1efc870-f093-4bbd-95b4-ed1ab9421f3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:02:35 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6d2c3a63-6171-4f43-9f42-efcbe28e24cd tempest-VolumeImageDependencyTests-954399749 None] Created volume successfully. Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Flow 'volume_create_manager' (724f938c-e959-424c-999f-07f3a7f1fd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f25190-69f4-4188-80b4-6c63429b4785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f25190-69f4-4188-80b4-6c63429b4785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-539237657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e813404e-79ce-4b06-9617-776671b5d1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c16cee00615496c9a6fd09d8a202035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:35Z,use_quota=True,user_id='5f27a10950ce4fcba31dd5368743d970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6a725b1-9e4c-4ab7-a38f-9e9f59bf1051),volume_type_id=a6a725b1-9e4c-4ab7-a38f-9e9f59bf1051)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79826fcb-486c-4d65-a29f-133dc4eda802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79826fcb-486c-4d65-a29f-133dc4eda802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10243391-df65-4061-86e3-c4c7f8d49755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10243391-df65-4061-86e3-c4c7f8d49755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e813404e-79ce-4b06-9617-776671b5d1ed', 'volume_name': 'volume-e813404e-79ce-4b06-9617-776671b5d1ed', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4e5820-d7e7-4bf2-84f7-ce3372e2cf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4e5820-d7e7-4bf2-84f7-ce3372e2cf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5579d6ff-74da-4dac-9fb3-cc82ad4298f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:35 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Volume e813404e-79ce-4b06-9617-776671b5d1ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e813404e-79ce-4b06-9617-776671b5d1ed', 'volume_size': 1} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-539237657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e813404e-79ce-4b06-9617-776671b5d1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c16cee00615496c9a6fd09d8a202035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:35Z,use_quota=True,user_id='5f27a10950ce4fcba31dd5368743d970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6a725b1-9e4c-4ab7-a38f-9e9f59bf1051),volume_type_id=a6a725b1-9e4c-4ab7-a38f-9e9f59bf1051)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Creating volume e813404e-79ce-4b06-9617-776671b5d1ed {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:02:35 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e813404e-79ce-4b06-9617-776671b5d1ed 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:35 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e813404e-79ce-4b06-9617-776671b5d1ed 1073741824 Jul 04 00:02:35 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] Acquiring lock "cinder-b55b8121-fb89-4852-9ece-a2f577e59aa8-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] Lock "cinder-b55b8121-fb89-4852-9ece-a2f577e59aa8-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:36 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:02:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Flow 'volume_create_manager' (c90a4048-d306-47bd-9f8e-f24bb4509da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:02:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e490f921-7d60-4c33-8ea8-0afdf16dd324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e490f921-7d60-4c33-8ea8-0afdf16dd324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-645962376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e2bacb-1746-4a46-b469-8f46e3565f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c16cee00615496c9a6fd09d8a202035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:36Z,use_quota=True,user_id='5f27a10950ce4fcba31dd5368743d970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(174864e4-e78a-482b-9f44-df44179f61d0),volume_type_id=174864e4-e78a-482b-9f44-df44179f61d0)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f1f868-eb5f-4a5f-8f05-e6390fafddb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f1f868-eb5f-4a5f-8f05-e6390fafddb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b91700c-cdc3-45e5-afa8-fbcc594f6af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b91700c-cdc3-45e5-afa8-fbcc594f6af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82e2bacb-1746-4a46-b469-8f46e3565f29', 'volume_name': 'volume-82e2bacb-1746-4a46-b469-8f46e3565f29', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f12e9a5-9d23-4b8a-b41d-b3038bd5ac6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f12e9a5-9d23-4b8a-b41d-b3038bd5ac6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c20b393-1b9d-438b-83dd-cdd159e4b365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:36 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Volume 82e2bacb-1746-4a46-b469-8f46e3565f29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82e2bacb-1746-4a46-b469-8f46e3565f29', 'volume_size': 1} Jul 04 00:02:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] Acquiring lock "cinder-quobyte-b55b8121-fb89-4852-9ece-a2f577e59aa8" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] Lock "cinder-quobyte-b55b8121-fb89-4852-9ece-a2f577e59aa8" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:36 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d794bea7-1729-4889-bcf0-689d8c809158]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:36 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 Jul 04 00:02:36 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:37 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e813404e-79ce-4b06-9617-776671b5d1ed 1073741824" returned: 0 in 1.977s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e813404e-79ce-4b06-9617-776671b5d1ed {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:37 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e813404e-79ce-4b06-9617-776671b5d1ed Jul 04 00:02:37 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Flow 'volume_create_manager' (47129950-7b2c-4c7e-af86-05634ea7bd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb7160e-a64d-4da1-b0c8-7c840999e558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb7160e-a64d-4da1-b0c8-7c840999e558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1492038400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a56531-2c9d-47bd-a5a4-d6a9a6477398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1039a215711f409bb549b25874ad913d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:38Z,use_quota=True,user_id='ff8c35df889f4c99ae6f935108a22e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b841621-d555-4806-8543-5c52fb08d797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b841621-d555-4806-8543-5c52fb08d797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae7d3b9-5245-4103-9980-337996d33be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae7d3b9-5245-4103-9980-337996d33be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0a56531-2c9d-47bd-a5a4-d6a9a6477398', 'volume_name': 'volume-e0a56531-2c9d-47bd-a5a4-d6a9a6477398', 'volume_size': 2}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2415a6a3-4b2d-4c23-9976-fbc8a086c0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2415a6a3-4b2d-4c23-9976-fbc8a086c0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a00984-b57b-439b-afba-fd404c56dc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Volume e0a56531-2c9d-47bd-a5a4-d6a9a6477398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0a56531-2c9d-47bd-a5a4-d6a9a6477398', 'volume_size': 2} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:02:38 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Flow 'volume_create_manager' (9482cffd-2e47-4740-98c2-76a3ae15e4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe55816-e52f-48e7-b41f-0ba3ba88562f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8" returned: 0 in 1.995s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe55816-e52f-48e7-b41f-0ba3ba88562f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2145723096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a4ca73-24ab-47d5-850b-0cd15f2eefe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c16cee00615496c9a6fd09d8a202035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:38Z,use_quota=True,user_id='5f27a10950ce4fcba31dd5368743d970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92db2835-feb0-446f-a0f7-606e4f8a1cc0),volume_type_id=92db2835-feb0-446f-a0f7-606e4f8a1cc0)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81be40e1-786b-4158-a1b3-54e768bd604d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81be40e1-786b-4158-a1b3-54e768bd604d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155fa6ec-e8bd-4262-8ee6-bcb38833b566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.image.glance [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Creating Keystone auth plugin from conf {{(pid=86676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 04 00:02:38 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 Jul 04 00:02:38 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:38 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e813404e-79ce-4b06-9617-776671b5d1ed" returned: 0 in 1.271s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] <== create_volume: return (3381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.387s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.540s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-645962376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e2bacb-1746-4a46-b469-8f46e3565f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c16cee00615496c9a6fd09d8a202035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:36Z,use_quota=True,user_id='5f27a10950ce4fcba31dd5368743d970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(174864e4-e78a-482b-9f44-df44179f61d0),volume_type_id=174864e4-e78a-482b-9f44-df44179f61d0)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Creating volume 82e2bacb-1746-4a46-b469-8f46e3565f29 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:02:38 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82e2bacb-1746-4a46-b469-8f46e3565f29 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:38 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82e2bacb-1746-4a46-b469-8f46e3565f29 1073741824 Jul 04 00:02:38 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5579d6ff-74da-4dac-9fb3-cc82ad4298f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e813404e-79ce-4b06-9617-776671b5d1ed', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512d79e6-2262-40f4-9aca-e1c61318edf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Volume volume-e813404e-79ce-4b06-9617-776671b5d1ed (e813404e-79ce-4b06-9617-776671b5d1ed): created successfully Jul 04 00:02:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512d79e6-2262-40f4-9aca-e1c61318edf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Flow 'volume_create_manager' (724f938c-e959-424c-999f-07f3a7f1fd11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:02:39 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-faa97853-4d86-4117-bde1-022fd7ac782b tempest-TestInstancesWithCinderVolumes-161535330 None] Created volume successfully. Jul 04 00:02:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155fa6ec-e8bd-4262-8ee6-bcb38833b566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30a4ca73-24ab-47d5-850b-0cd15f2eefe1', 'volume_name': 'volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1', 'volume_size': 1, 'image_id': 'a5ad9e82-f182-48c0-871e-912d1bfa8195', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5ad9e82-f182-48c0-871e-912d1bfa8195', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1727864722', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4c16cee00615496c9a6fd09d8a202035', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5ad9e82-f182-48c0-871e-912d1bfa8195', 'created_at': datetime.datetime(2026, 7, 3, 22, 2, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 2, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5ad9e82-f182-48c0-871e-912d1bfa8195/file', 'properties': {}}, 'image_service': }' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca36c66-4530-4abe-94e5-d11400d641cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca36c66-4530-4abe-94e5-d11400d641cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4864450-3306-43ac-b9f7-e1f631a4ecf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:39 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Volume 30a4ca73-24ab-47d5-850b-0cd15f2eefe1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1', 'volume_size': 1, 'image_id': 'a5ad9e82-f182-48c0-871e-912d1bfa8195', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5ad9e82-f182-48c0-871e-912d1bfa8195', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1727864722', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4c16cee00615496c9a6fd09d8a202035', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5ad9e82-f182-48c0-871e-912d1bfa8195', 'created_at': datetime.datetime(2026, 7, 3, 22, 2, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 2, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5ad9e82-f182-48c0-871e-912d1bfa8195/file', 'properties': {}}, 'image_service': } Jul 04 00:02:39 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Trying to clone 30a4ca73-24ab-47d5-850b-0cd15f2eefe1 from image a5ad9e82-f182-48c0-871e-912d1bfa8195 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5ad9e82-f182-48c0-871e-912d1bfa8195', 'metadata': {}}]). {{(pid=86676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 04 00:02:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8" returned: 1 in 1.149s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:02:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:39 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:39 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8 Jul 04 00:02:39 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:40 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82e2bacb-1746-4a46-b469-8f46e3565f29 1073741824" returned: 0 in 1.438s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82e2bacb-1746-4a46-b469-8f46e3565f29 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:40 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82e2bacb-1746-4a46-b469-8f46e3565f29 Jul 04 00:02:40 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:40 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b55b8121-fb89-4852-9ece-a2f577e59aa8" returned: 0 in 0.962s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] Lock "cinder-quobyte-b55b8121-fb89-4852-9ece-a2f577e59aa8" released by "delete_volume" :: held 4.228s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:40 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] Created reservations ['b33102ef-c3c4-4495-9c56-c996e043a4de', '6a7b6e3d-3e4b-4d70-8f38-58a99e7a4aa1', '5d25b88d-89f8-446b-86ca-25e21f02ad1f', '77052424-c2f8-4bf5-96be-dc3fa2e0eab5'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:02:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:02:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:02:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:40 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:02:40 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:41 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82e2bacb-1746-4a46-b469-8f46e3565f29" returned: 0 in 0.956s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] <== create_volume: return (2463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.468s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.024s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1492038400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a56531-2c9d-47bd-a5a4-d6a9a6477398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1039a215711f409bb549b25874ad913d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:38Z,use_quota=True,user_id='ff8c35df889f4c99ae6f935108a22e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Creating volume e0a56531-2c9d-47bd-a5a4-d6a9a6477398 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:02:41 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e0a56531-2c9d-47bd-a5a4-d6a9a6477398 2147483648 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c20b393-1b9d-438b-83dd-cdd159e4b365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82e2bacb-1746-4a46-b469-8f46e3565f29', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:41 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e0a56531-2c9d-47bd-a5a4-d6a9a6477398 2147483648 Jul 04 00:02:41 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a86b7c6-088e-4fad-a662-8c9adef2e4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:41 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Volume volume-82e2bacb-1746-4a46-b469-8f46e3565f29 (82e2bacb-1746-4a46-b469-8f46e3565f29): created successfully Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a86b7c6-088e-4fad-a662-8c9adef2e4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Flow 'volume_create_manager' (c90a4048-d306-47bd-9f8e-f24bb4509da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:02:41 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2a3fe023-afd3-4b70-b191-eed7dc028e5e tempest-TestInstancesWithCinderVolumes-161535330 None] Created volume successfully. Jul 04 00:02:41 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.924s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:02:41 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] Deleted volume successfully. Jul 04 00:02:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5794bcc5-a216-4b0e-8470-ee4c28375cfb tempest-VolumeImageDependencyTests-954399749 None] Lock "cinder-b55b8121-fb89-4852-9ece-a2f577e59aa8-delete_volume" released by "delete_volume" :: held 5.685s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:42 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e0a56531-2c9d-47bd-a5a4-d6a9a6477398 2147483648" returned: 0 in 1.248s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e0a56531-2c9d-47bd-a5a4-d6a9a6477398 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:42 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e0a56531-2c9d-47bd-a5a4-d6a9a6477398 Jul 04 00:02:42 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:43 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e0a56531-2c9d-47bd-a5a4-d6a9a6477398" returned: 0 in 0.888s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] <== create_volume: return (2207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:02:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a00984-b57b-439b-afba-fd404c56dc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a56531-2c9d-47bd-a5a4-d6a9a6477398', 'volume_size': 2}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3e3a6a-a638-4026-924b-f7ede31b4aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:43 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Volume volume-e0a56531-2c9d-47bd-a5a4-d6a9a6477398 (e0a56531-2c9d-47bd-a5a4-d6a9a6477398): created successfully Jul 04 00:02:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3e3a6a-a638-4026-924b-f7ede31b4aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Flow 'volume_create_manager' (47129950-7b2c-4c7e-af86-05634ea7bd7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:02:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-cdef8d45-362b-4d34-8fc2-65762bbeae80 tempest-VolumesCloneNegativeTest-677069360 None] Created volume successfully. Jul 04 00:02:44 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5ad9e82-f182-48c0-871e-912d1bfa8195_7vo135w_devstack@QuobyteHD, size 20.69 MB, duration 4.84 sec {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 04 00:02:44 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Image download 20.69 MB at 4.27 MB/s Jul 04 00:02:44 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[608c536d-a161-4ac8-bef0-3adac53f73ae]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ad9e82-f182-48c0-871e-912d1bfa8195_7vo135w_devstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:44 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ad9e82-f182-48c0-871e-912d1bfa8195_7vo135w_devstack@QuobyteHD Jul 04 00:02:44 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] Acquiring lock "cinder-e0a56531-2c9d-47bd-a5a4-d6a9a6477398-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] Lock "cinder-e0a56531-2c9d-47bd-a5a4-d6a9a6477398-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] Acquiring lock "cinder-quobyte-e0a56531-2c9d-47bd-a5a4-d6a9a6477398" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:02:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] Lock "cinder-quobyte-e0a56531-2c9d-47bd-a5a4-d6a9a6477398" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:02:44 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[540ca8ba-0647-4710-b3b4-737c40219b01]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e0a56531-2c9d-47bd-a5a4-d6a9a6477398 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:44 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e0a56531-2c9d-47bd-a5a4-d6a9a6477398 Jul 04 00:02:44 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:45 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ad9e82-f182-48c0-871e-912d1bfa8195_7vo135w_devstack@QuobyteHD" returned: 0 in 0.963s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:45 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Temporary image a5ad9e82-f182-48c0-871e-912d1bfa8195 is fetched for user 5f27a10950ce4fcba31dd5368743d970. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 04 00:02:45 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[81748d03-42de-4821-b980-7ea4fb50d8e9]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ad9e82-f182-48c0-871e-912d1bfa8195_7vo135w_devstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:45 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ad9e82-f182-48c0-871e-912d1bfa8195_7vo135w_devstack@QuobyteHD Jul 04 00:02:45 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:45 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e0a56531-2c9d-47bd-a5a4-d6a9a6477398" returned: 0 in 1.085s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e0a56531-2c9d-47bd-a5a4-d6a9a6477398 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:45 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e0a56531-2c9d-47bd-a5a4-d6a9a6477398 Jul 04 00:02:45 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:46 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ad9e82-f182-48c0-871e-912d1bfa8195_7vo135w_devstack@QuobyteHD" returned: 0 in 1.069s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2145723096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a4ca73-24ab-47d5-850b-0cd15f2eefe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c16cee00615496c9a6fd09d8a202035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:38Z,use_quota=True,user_id='5f27a10950ce4fcba31dd5368743d970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92db2835-feb0-446f-a0f7-606e4f8a1cc0),volume_type_id=92db2835-feb0-446f-a0f7-606e4f8a1cc0)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Creating volume 30a4ca73-24ab-47d5-850b-0cd15f2eefe1 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:02:46 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:46 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 1073741824 Jul 04 00:02:46 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Flow 'volume_create_manager' (9c649cf4-e76b-4a6a-b8ed-3c2894ec99ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bdfc8cd-4c62-4957-872e-231978ff55b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bdfc8cd-4c62-4957-872e-231978ff55b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d73571-b50c-474d-8777-7dc0398a4d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='977e223328e64b41a5051fd1c83802b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:46Z,use_quota=True,user_id='14f206db4b184daca07c0e7a7a73a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c846e36-1145-43fa-b514-ffca201b6070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c846e36-1145-43fa-b514-ffca201b6070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b880b265-0a66-4129-bd34-ccc8d356c9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b880b265-0a66-4129-bd34-ccc8d356c9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91d73571-b50c-474d-8777-7dc0398a4d71', 'volume_name': 'volume-91d73571-b50c-474d-8777-7dc0398a4d71', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332b037d-1a5d-4eda-98fa-f17e03dafda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332b037d-1a5d-4eda-98fa-f17e03dafda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a76002-f80b-41e0-9dd0-139d05b997fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:46 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Volume 91d73571-b50c-474d-8777-7dc0398a4d71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91d73571-b50c-474d-8777-7dc0398a4d71', 'volume_size': 1} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:46 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e0a56531-2c9d-47bd-a5a4-d6a9a6477398" returned: 0 in 0.988s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] Lock "cinder-quobyte-e0a56531-2c9d-47bd-a5a4-d6a9a6477398" released by "delete_volume" :: held 2.135s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] Created reservations ['769db779-73f6-417e-9834-aa9d70dbc168', '8cb6b34b-206a-43c0-bb20-b82b63e239f3', '0e55f3b7-3e60-4fd4-9223-59836b70af04', 'd6a0de1a-e2bc-44b4-afc1-618321bcd630'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:47 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:02:47 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:47 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 1073741824" returned: 0 in 1.089s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:47 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 Jul 04 00:02:47 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:47 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.869s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:47 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:02:47 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] Deleted volume successfully. Jul 04 00:02:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-17a77399-2ada-4a2a-8487-0b1f8812011c tempest-VolumesCloneNegativeTest-677069360 None] Lock "cinder-e0a56531-2c9d-47bd-a5a4-d6a9a6477398-delete_volume" released by "delete_volume" :: held 3.329s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:02:48 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1" returned: 0 in 1.013s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] <== create_volume: return (2181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:02:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.186s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d73571-b50c-474d-8777-7dc0398a4d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='977e223328e64b41a5051fd1c83802b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:46Z,use_quota=True,user_id='14f206db4b184daca07c0e7a7a73a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:02:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Creating volume 91d73571-b50c-474d-8777-7dc0398a4d71 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:02:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:02:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:02:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:02:48 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:02:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-91d73571-b50c-474d-8777-7dc0398a4d71 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:48 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-91d73571-b50c-474d-8777-7dc0398a4d71 1073741824 Jul 04 00:02:48 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:48 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Attempting download of a5ad9e82-f182-48c0-871e-912d1bfa8195 ((None, [{'url': 'file:///opt/stack/data/glance/images/a5ad9e82-f182-48c0-871e-912d1bfa8195', 'metadata': {}}])) to volume 30a4ca73-24ab-47d5-850b-0cd15f2eefe1. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 04 00:02:48 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c458cf13-5ac2-438b-8784-c71303b546a3]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5ad9e82-f182-48c0-871e-912d1bfa8195_kjj44o9z {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:48 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5ad9e82-f182-48c0-871e-912d1bfa8195_kjj44o9z Jul 04 00:02:48 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:49 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-91d73571-b50c-474d-8777-7dc0398a4d71 1073741824" returned: 0 in 1.335s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:49 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-91d73571-b50c-474d-8777-7dc0398a4d71 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5ad9e82-f182-48c0-871e-912d1bfa8195_kjj44o9z" returned: 0 in 1.236s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5ad9e82-f182-48c0-871e-912d1bfa8195_kjj44o9z {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:50 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-91d73571-b50c-474d-8777-7dc0398a4d71 Jul 04 00:02:50 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:50 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5ad9e82-f182-48c0-871e-912d1bfa8195_kjj44o9z Jul 04 00:02:50 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:50 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-91d73571-b50c-474d-8777-7dc0398a4d71" returned: 0 in 0.975s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] <== create_volume: return (2375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:02:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.378s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:50 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5ad9e82-f182-48c0-871e-912d1bfa8195_kjj44o9z" returned: 1 in 0.970s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5ad9e82-f182-48c0-871e-912d1bfa8195_kjj44o9z' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:02:50 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba8f0a1-8d88-4430-bacc-58c8fddec64f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ad9e82-f182-48c0-871e-912d1bfa8195_7vo135w_devstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a76002-f80b-41e0-9dd0-139d05b997fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91d73571-b50c-474d-8777-7dc0398a4d71', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11622dae-4a8e-4300-bdf2-8514884b5d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:51 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Volume volume-91d73571-b50c-474d-8777-7dc0398a4d71 (91d73571-b50c-474d-8777-7dc0398a4d71): created successfully Jul 04 00:02:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11622dae-4a8e-4300-bdf2-8514884b5d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Flow 'volume_create_manager' (9c649cf4-e76b-4a6a-b8ed-3c2894ec99ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:02:51 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9dbc8fe7-e41b-4583-8b46-0726fe9fc07d tempest-CinderUnicodeTest-1881852108 None] Created volume successfully. Jul 04 00:02:51 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ad9e82-f182-48c0-871e-912d1bfa8195_7vo135w_devstack@QuobyteHD Jul 04 00:02:51 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:51 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ad9e82-f182-48c0-871e-912d1bfa8195_7vo135w_devstack@QuobyteHD" returned: 0 in 1.006s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:51 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] a5ad9e82-f182-48c0-871e-912d1bfa8195 was qcow2, converting to raw {{(pid=86676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 04 00:02:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5ad9e82-f182-48c0-871e-912d1bfa8195_7vo135w_devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:52 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5ad9e82-f182-48c0-871e-912d1bfa8195_7vo135w_devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 Jul 04 00:02:52 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Flow 'volume_create_manager' (459a70d1-301e-45f1-bdee-1f9e65e4c03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c9094e-0ea1-4eb8-9bf1-5def66d12e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c9094e-0ea1-4eb8-9bf1-5def66d12e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:02:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-86039781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329b7fc0-77c7-4055-95e3-75786a044895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='977e223328e64b41a5051fd1c83802b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:53Z,use_quota=True,user_id='14f206db4b184daca07c0e7a7a73a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c83eb1-af22-4cd5-9c1e-ef1eb63374b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c83eb1-af22-4cd5-9c1e-ef1eb63374b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab859a11-ffb8-4e97-b9c9-bc5aa24e122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab859a11-ffb8-4e97-b9c9-bc5aa24e122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '329b7fc0-77c7-4055-95e3-75786a044895', 'volume_name': 'volume-329b7fc0-77c7-4055-95e3-75786a044895', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2c9da7-6e35-47d0-bc7c-7751adf22e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2c9da7-6e35-47d0-bc7c-7751adf22e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0e3af6-ca63-4457-af23-cc27a1ecf6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:52 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Volume 329b7fc0-77c7-4055-95e3-75786a044895: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-329b7fc0-77c7-4055-95e3-75786a044895', 'volume_size': 1} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:02:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-86039781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329b7fc0-77c7-4055-95e3-75786a044895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='977e223328e64b41a5051fd1c83802b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:53Z,use_quota=True,user_id='14f206db4b184daca07c0e7a7a73a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Creating volume 329b7fc0-77c7-4055-95e3-75786a044895 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:02:52 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:52 devstack sudo[98393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895 1073741824 Jul 04 00:02:52 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Flow 'volume_create_manager' (e7c80f29-37b0-45f3-aec5-d70843eff9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:02:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c3b123d-545c-4c26-8b23-4cac099549d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c3b123d-545c-4c26-8b23-4cac099549d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1337501784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b64d7d2-db19-4d09-bfd6-8061bfeb3487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b82cf236ce48a6b93f7b71dd168e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:53Z,use_quota=True,user_id='f975059994954357916228be607e57b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6335c7c0-9c8a-4374-a542-208702141d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6335c7c0-9c8a-4374-a542-208702141d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788bbb42-1e09-45b7-9e0f-badf3ea1ee3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788bbb42-1e09-45b7-9e0f-badf3ea1ee3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b64d7d2-db19-4d09-bfd6-8061bfeb3487', 'volume_name': 'volume-0b64d7d2-db19-4d09-bfd6-8061bfeb3487', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f72471b-2fa5-43ae-be65-884e803103a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f72471b-2fa5-43ae-be65-884e803103a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff5e330-68fc-46b3-8228-41c3b5c0cd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:53 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Volume 0b64d7d2-db19-4d09-bfd6-8061bfeb3487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b64d7d2-db19-4d09-bfd6-8061bfeb3487', 'volume_size': 1} Jul 04 00:02:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:54 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895 1073741824" returned: 0 in 1.174s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:54 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895 Jul 04 00:02:54 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:54 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5ad9e82-f182-48c0-871e-912d1bfa8195_7vo135w_devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1" returned: 0 in 2.597s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5ad9e82-f182-48c0-871e-912d1bfa8195_7vo135w_devstack@QuobyteHD, size 112.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 04 00:02:54 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Converted 112.00 MB image at 43.10 MB/s Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:54 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 1G Jul 04 00:02:54 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:54 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895" returned: 0 in 0.874s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.113s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.874s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1337501784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b64d7d2-db19-4d09-bfd6-8061bfeb3487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b82cf236ce48a6b93f7b71dd168e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:53Z,use_quota=True,user_id='f975059994954357916228be607e57b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Creating volume 0b64d7d2-db19-4d09-bfd6-8061bfeb3487 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:02:54 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0b64d7d2-db19-4d09-bfd6-8061bfeb3487 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:54 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0b64d7d2-db19-4d09-bfd6-8061bfeb3487 1073741824 Jul 04 00:02:54 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0e3af6-ca63-4457-af23-cc27a1ecf6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-329b7fc0-77c7-4055-95e3-75786a044895', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (239cc984-5efa-4016-8de8-e716bf7de51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:55 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Volume volume-329b7fc0-77c7-4055-95e3-75786a044895 (329b7fc0-77c7-4055-95e3-75786a044895): created successfully Jul 04 00:02:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (239cc984-5efa-4016-8de8-e716bf7de51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Flow 'volume_create_manager' (459a70d1-301e-45f1-bdee-1f9e65e4c03c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:02:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-46998cca-376b-40f3-a709-44ef6291437e tempest-CinderUnicodeTest-1881852108 None] Created volume successfully. Jul 04 00:02:55 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 1G" returned: 0 in 0.859s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:55 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d99f0d-c372-4db1-93b6-1875ee9faafe]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:55 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 Jul 04 00:02:55 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:56 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0b64d7d2-db19-4d09-bfd6-8061bfeb3487 1073741824" returned: 0 in 1.192s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5816def1-d139-40c9-95fa-64d1820b9563 tempest-CinderUnicodeTest-1881852108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:02:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0b64d7d2-db19-4d09-bfd6-8061bfeb3487 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:56 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0b64d7d2-db19-4d09-bfd6-8061bfeb3487 Jul 04 00:02:56 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:56 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1" returned: 0 in 1.009s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:56 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 Jul 04 00:02:56 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:57 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0b64d7d2-db19-4d09-bfd6-8061bfeb3487" returned: 0 in 0.888s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] <== create_volume: return (2133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.136s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5816def1-d139-40c9-95fa-64d1820b9563 tempest-CinderUnicodeTest-1881852108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.912s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff5e330-68fc-46b3-8228-41c3b5c0cd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b64d7d2-db19-4d09-bfd6-8061bfeb3487', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9439f9-07f5-4c40-88ef-dcc4dceaaa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-5816def1-d139-40c9-95fa-64d1820b9563 tempest-CinderUnicodeTest-1881852108 None] Creating offline snapshot d8fe69f4-cede-4226-bb3d-9080b03ca161 of volume 329b7fc0-77c7-4055-95e3-75786a044895 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:02:57 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Volume volume-0b64d7d2-db19-4d09-bfd6-8061bfeb3487 (0b64d7d2-db19-4d09-bfd6-8061bfeb3487): created successfully Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9439f9-07f5-4c40-88ef-dcc4dceaaa9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Flow 'volume_create_manager' (e7c80f29-37b0-45f3-aec5-d70843eff9a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2d5f50-a275-4329-b2d4-35aad1faa6be]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5816def1-d139-40c9-95fa-64d1820b9563 tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3fc7d926-f755-483b-b9b8-a4cae274ca7e tempest-VolumesNegativeTest-756361154 None] Created volume successfully. Jul 04 00:02:57 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895 Jul 04 00:02:57 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:57 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1" returned: 1 in 1.054s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Downloaded image a5ad9e82-f182-48c0-871e-912d1bfa8195 ((None, [{'url': 'file:///opt/stack/data/glance/images/a5ad9e82-f182-48c0-871e-912d1bfa8195', 'metadata': {}}])) to volume 30a4ca73-24ab-47d5-850b-0cd15f2eefe1 successfully. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Temporary image a5ad9e82-f182-48c0-871e-912d1bfa8195 for user 5f27a10950ce4fcba31dd5368743d970 is deleted. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Marking volume 30a4ca73-24ab-47d5-850b-0cd15f2eefe1 as bootable. {{(pid=86676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Copying metadata from image a5ad9e82-f182-48c0-871e-912d1bfa8195 to 30a4ca73-24ab-47d5-850b-0cd15f2eefe1. {{(pid=86676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Creating volume glance metadata for volume 30a4ca73-24ab-47d5-850b-0cd15f2eefe1 backed by image a5ad9e82-f182-48c0-871e-912d1bfa8195 with: {'image_id': 'a5ad9e82-f182-48c0-871e-912d1bfa8195', 'image_name': 'tempest-scenario-img--1727864722', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4864450-3306-43ac-b9f7-e1f631a4ecf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1', 'volume_size': 1, 'image_id': 'a5ad9e82-f182-48c0-871e-912d1bfa8195', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5ad9e82-f182-48c0-871e-912d1bfa8195', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1727864722', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4c16cee00615496c9a6fd09d8a202035', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5ad9e82-f182-48c0-871e-912d1bfa8195', 'created_at': datetime.datetime(2026, 7, 3, 22, 2, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 2, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5ad9e82-f182-48c0-871e-912d1bfa8195/file', 'properties': {}}, 'image_service': }' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3814c6cb-e711-4329-ad13-ca9fce41091c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:02:57 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Volume volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 (30a4ca73-24ab-47d5-850b-0cd15f2eefe1): created successfully Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3814c6cb-e711-4329-ad13-ca9fce41091c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Flow 'volume_create_manager' (9482cffd-2e47-4740-98c2-76a3ae15e4ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:02:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b7b14da4-6eb3-446b-9faf-711abe462227 tempest-TestInstancesWithCinderVolumes-161535330 None] Created volume successfully. Jul 04 00:02:57 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5816def1-d139-40c9-95fa-64d1820b9563 tempest-CinderUnicodeTest-1881852108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895" returned: 0 in 0.811s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5816def1-d139-40c9-95fa-64d1820b9563 tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:58 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161 1G Jul 04 00:02:58 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:58 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5816def1-d139-40c9-95fa-64d1820b9563 tempest-CinderUnicodeTest-1881852108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161 1G" returned: 0 in 0.991s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5816def1-d139-40c9-95fa-64d1820b9563 tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-329b7fc0-77c7-4055-95e3-75786a044895 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:58 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-329b7fc0-77c7-4055-95e3-75786a044895 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161 Jul 04 00:02:58 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:02:59 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Jul 04 00:02:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5816def1-d139-40c9-95fa-64d1820b9563 tempest-CinderUnicodeTest-1881852108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-329b7fc0-77c7-4055-95e3-75786a044895 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161" returned: 0 in 0.869s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:02:59 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-5816def1-d139-40c9-95fa-64d1820b9563 tempest-CinderUnicodeTest-1881852108 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161 is being set with open permissions: ugo+rw Jul 04 00:02:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5816def1-d139-40c9-95fa-64d1820b9563 tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:02:59 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161 Jul 04 00:02:59 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:00 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5816def1-d139-40c9-95fa-64d1820b9563 tempest-CinderUnicodeTest-1881852108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161" returned: 0 in 0.674s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5816def1-d139-40c9-95fa-64d1820b9563 tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:00 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.info Jul 04 00:03:00 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:01 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5816def1-d139-40c9-95fa-64d1820b9563 tempest-CinderUnicodeTest-1881852108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.info" returned: 0 in 0.671s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:01 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-5816def1-d139-40c9-95fa-64d1820b9563 tempest-CinderUnicodeTest-1881852108 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.info is being set with open permissions: ugo+rw Jul 04 00:03:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5816def1-d139-40c9-95fa-64d1820b9563 tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:01 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.info Jul 04 00:03:01 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:01 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5816def1-d139-40c9-95fa-64d1820b9563 tempest-CinderUnicodeTest-1881852108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.info" returned: 0 in 0.711s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5816def1-d139-40c9-95fa-64d1820b9563 tempest-CinderUnicodeTest-1881852108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.883s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:03:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5816def1-d139-40c9-95fa-64d1820b9563 tempest-CinderUnicodeTest-1881852108 None] Create snapshot completed successfully Jul 04 00:03:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] Acquiring lock "cinder-d8fe69f4-cede-4226-bb3d-9080b03ca161-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:03:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] Lock "cinder-d8fe69f4-cede-4226-bb3d-9080b03ca161-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:03:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] Acquiring lock "cinder-quobyte-329b7fc0-77c7-4055-95e3-75786a044895" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:03:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] Lock "cinder-quobyte-329b7fc0-77c7-4055-95e3-75786a044895" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:03:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] Acquiring lock "cinder-quobyte-d8fe69f4-cede-4226-bb3d-9080b03ca161" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:03:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] Lock "cinder-quobyte-d8fe69f4-cede-4226-bb3d-9080b03ca161" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:03:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] Deleting offline snapshot d8fe69f4-cede-4226-bb3d-9080b03ca161 of volume 329b7fc0-77c7-4055-95e3-75786a044895 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:03:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] snapshot_file for this snap is: volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:03:02 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[241e16c2-4dec-4788-aedd-f856f37da342]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:03:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:02 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161 Jul 04 00:03:02 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:03 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161" returned: 0 in 1.064s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-329b7fc0-77c7-4055-95e3-75786a044895(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:03:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c524cd8c-852e-422a-8b47-b6c36c777208]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:03:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:03 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895 Jul 04 00:03:03 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:04 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895" returned: 0 in 0.986s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:04 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161 Jul 04 00:03:04 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:05 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161" returned: 0 in 0.932s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:05 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161 Jul 04 00:03:05 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:06 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895.d8fe69f4-cede-4226-bb3d-9080b03ca161" returned: 0 in 0.903s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] Lock "cinder-quobyte-d8fe69f4-cede-4226-bb3d-9080b03ca161" released by "_delete_snapshot" :: held 4.033s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:03:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] Lock "cinder-quobyte-329b7fc0-77c7-4055-95e3-75786a044895" released by "delete_snapshot" :: held 4.062s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:03:06 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] Created reservations ['0462dee0-f81e-4cf5-a8da-4afda702539b', '027d2030-5af7-4708-8f5c-c51fd9a09087', 'f1d80cb7-ad0e-4623-baf6-2059c1c7d6e5', '94cbd16e-0612-4a05-874b-d290b21be168'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:03:06 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] Delete snapshot completed successfully. Jul 04 00:03:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-59ae91b5-5f72-4a50-b515-e6965d4a2cdf tempest-CinderUnicodeTest-1881852108 None] Lock "cinder-d8fe69f4-cede-4226-bb3d-9080b03ca161-delete_snapshot" released by "delete_snapshot" :: held 4.242s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:03:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] Acquiring lock "cinder-329b7fc0-77c7-4055-95e3-75786a044895-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:03:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] Lock "cinder-329b7fc0-77c7-4055-95e3-75786a044895-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:03:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] Acquiring lock "cinder-quobyte-329b7fc0-77c7-4055-95e3-75786a044895" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:03:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] Lock "cinder-quobyte-329b7fc0-77c7-4055-95e3-75786a044895" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:03:07 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b425b59-d505-445c-b156-707d0926305a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:03:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:07 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895 Jul 04 00:03:07 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-c93f932e-1051-43e7-b9ea-b1c16784e51d req-e816780b-15df-45b0-8f19-5910481c0b31 tempest-TestInstancesWithCinderVolumes-161535330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:03:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-c93f932e-1051-43e7-b9ea-b1c16784e51d req-e816780b-15df-45b0-8f19-5910481c0b31 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:03:08 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbb9373-15ce-426b-b552-44d2b415d0c8]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:03:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c93f932e-1051-43e7-b9ea-b1c16784e51d req-e816780b-15df-45b0-8f19-5910481c0b31 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:08 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 Jul 04 00:03:08 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895" returned: 0 in 1.525s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:08 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:08 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895 Jul 04 00:03:08 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:09 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c93f932e-1051-43e7-b9ea-b1c16784e51d req-e816780b-15df-45b0-8f19-5910481c0b31 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1" returned: 0 in 1.378s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c93f932e-1051-43e7-b9ea-b1c16784e51d req-e816780b-15df-45b0-8f19-5910481c0b31 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:09 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 Jul 04 00:03:09 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:09 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-329b7fc0-77c7-4055-95e3-75786a044895" returned: 0 in 1.238s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] Lock "cinder-quobyte-329b7fc0-77c7-4055-95e3-75786a044895" released by "delete_volume" :: held 2.869s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:03:09 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] Created reservations ['7006503c-f7a4-46d8-b488-a26ad3b69c3b', '40c78218-c715-49db-b839-1ad5592ce9a4', 'cff9cd6e-0dba-4001-a8fe-0bedc72d6965', 'df2c17db-d4ec-4a3c-882d-ff006aa542c7'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:03:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:03:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:03:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:03:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:03:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:03:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:10 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:03:10 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] Acquiring lock "cinder-91d73571-b50c-474d-8777-7dc0398a4d71-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:03:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] Lock "cinder-91d73571-b50c-474d-8777-7dc0398a4d71-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:03:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] Acquiring lock "cinder-quobyte-91d73571-b50c-474d-8777-7dc0398a4d71" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:03:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] Lock "cinder-quobyte-91d73571-b50c-474d-8777-7dc0398a4d71" acquired by "delete_volume" :: waited 0.059s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:03:10 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9116cbd9-5f87-4591-bed3-97daf435fd43]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:03:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-91d73571-b50c-474d-8777-7dc0398a4d71 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:10 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c93f932e-1051-43e7-b9ea-b1c16784e51d req-e816780b-15df-45b0-8f19-5910481c0b31 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1" returned: 1 in 1.484s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c93f932e-1051-43e7-b9ea-b1c16784e51d req-e816780b-15df-45b0-8f19-5910481c0b31 tempest-TestInstancesWithCinderVolumes-161535330 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:03:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-c93f932e-1051-43e7-b9ea-b1c16784e51d req-e816780b-15df-45b0-8f19-5910481c0b31 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.956s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:03:10 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-91d73571-b50c-474d-8777-7dc0398a4d71 Jul 04 00:03:10 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-c93f932e-1051-43e7-b9ea-b1c16784e51d req-e816780b-15df-45b0-8f19-5910481c0b31 tempest-TestInstancesWithCinderVolumes-161535330 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc031468-ed5f-492d-9841-ccd230dc2bcb', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 04 00:03:11 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-c93f932e-1051-43e7-b9ea-b1c16784e51d req-e816780b-15df-45b0-8f19-5910481c0b31 tempest-TestInstancesWithCinderVolumes-161535330 None] attachment_update completed successfully. Jul 04 00:03:12 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 2.051s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:12 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:03:12 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] Deleted volume successfully. Jul 04 00:03:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dadeb821-ed13-4715-8476-cfc5e1f54571 tempest-CinderUnicodeTest-1881852108 None] Lock "cinder-329b7fc0-77c7-4055-95e3-75786a044895-delete_volume" released by "delete_volume" :: held 5.397s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:03:12 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-91d73571-b50c-474d-8777-7dc0398a4d71" returned: 0 in 1.783s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-91d73571-b50c-474d-8777-7dc0398a4d71 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:12 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-91d73571-b50c-474d-8777-7dc0398a4d71 Jul 04 00:03:12 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:14 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-91d73571-b50c-474d-8777-7dc0398a4d71" returned: 0 in 1.880s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] Lock "cinder-quobyte-91d73571-b50c-474d-8777-7dc0398a4d71" released by "delete_volume" :: held 3.795s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:03:14 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] Created reservations ['0c958987-4a47-4f5f-b2e1-482dcafbad85', '088b206a-0d88-4d26-ac76-432e7a7402b7', '878eb816-4437-475b-a101-d5bb64212d8c', '8f9e1ffc-b425-40d7-9b58-11497a774247'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:03:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:03:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:03:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:03:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:03:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:03:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:14 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:03:14 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:16 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.500s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:16 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:03:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] Deleted volume successfully. Jul 04 00:03:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5c3acd0f-1a89-4c1b-b241-242badd6174d tempest-CinderUnicodeTest-1881852108 None] Lock "cinder-91d73571-b50c-474d-8777-7dc0398a4d71-delete_volume" released by "delete_volume" :: held 5.942s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Flow 'volume_create_manager' (4599d74b-db49-498c-9507-d992c5703269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba48029a-c22b-4781-889f-8827243baab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba48029a-c22b-4781-889f-8827243baab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1100283755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2284535-bcc9-48d1-9214-90a16a12b670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6ccfd420494ccdaebe6e3887f6bfd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:24Z,use_quota=True,user_id='c3f235a4b50342a191792169d45b414f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630710b8-ae3d-42d6-8c70-84b94b82fb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630710b8-ae3d-42d6-8c70-84b94b82fb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deafe45e-e1bd-46ae-99ca-e6044b024251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deafe45e-e1bd-46ae-99ca-e6044b024251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2284535-bcc9-48d1-9214-90a16a12b670', 'volume_name': 'volume-b2284535-bcc9-48d1-9214-90a16a12b670', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7beabe0e-9f29-4f18-95d1-d73cd271d217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7beabe0e-9f29-4f18-95d1-d73cd271d217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfdd59e5-7544-4c6a-9c32-cacbdf79e038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:03:24 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Volume b2284535-bcc9-48d1-9214-90a16a12b670: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2284535-bcc9-48d1-9214-90a16a12b670', 'volume_size': 1} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1100283755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2284535-bcc9-48d1-9214-90a16a12b670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6ccfd420494ccdaebe6e3887f6bfd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:24Z,use_quota=True,user_id='c3f235a4b50342a191792169d45b414f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Creating volume b2284535-bcc9-48d1-9214-90a16a12b670 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:03:24 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:03:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b2284535-bcc9-48d1-9214-90a16a12b670 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:24 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b2284535-bcc9-48d1-9214-90a16a12b670 1073741824 Jul 04 00:03:24 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:26 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b2284535-bcc9-48d1-9214-90a16a12b670 1073741824" returned: 0 in 1.544s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b2284535-bcc9-48d1-9214-90a16a12b670 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:26 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b2284535-bcc9-48d1-9214-90a16a12b670 Jul 04 00:03:26 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:27 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b2284535-bcc9-48d1-9214-90a16a12b670" returned: 0 in 1.078s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] <== create_volume: return (2684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:03:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.692s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:03:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfdd59e5-7544-4c6a-9c32-cacbdf79e038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2284535-bcc9-48d1-9214-90a16a12b670', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:03:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6836662-693b-40b3-860c-c651f0e16de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:03:27 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Volume volume-b2284535-bcc9-48d1-9214-90a16a12b670 (b2284535-bcc9-48d1-9214-90a16a12b670): created successfully Jul 04 00:03:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6836662-693b-40b3-860c-c651f0e16de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:03:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Flow 'volume_create_manager' (4599d74b-db49-498c-9507-d992c5703269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:03:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-52814b0a-381c-4c3b-b225-33a4b0a94d9b tempest-ProjectReaderTests-381090088 None] Created volume successfully. Jul 04 00:03:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] Acquiring lock "cinder-b2284535-bcc9-48d1-9214-90a16a12b670-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:03:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] Lock "cinder-b2284535-bcc9-48d1-9214-90a16a12b670-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:03:28 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=79,cinder:INSERT=20,cinder:UPDATE=77,cinder:DELETE=6 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:03:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] Acquiring lock "cinder-quobyte-b2284535-bcc9-48d1-9214-90a16a12b670" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:03:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] Lock "cinder-quobyte-b2284535-bcc9-48d1-9214-90a16a12b670" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:03:28 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f0bcf2-65bd-4e1d-89bf-03e49c24c461]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:03:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b2284535-bcc9-48d1-9214-90a16a12b670 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:28 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b2284535-bcc9-48d1-9214-90a16a12b670 Jul 04 00:03:28 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:29 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b2284535-bcc9-48d1-9214-90a16a12b670" returned: 0 in 1.105s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b2284535-bcc9-48d1-9214-90a16a12b670 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:29 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b2284535-bcc9-48d1-9214-90a16a12b670 Jul 04 00:03:29 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:30 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b2284535-bcc9-48d1-9214-90a16a12b670" returned: 0 in 0.858s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] Lock "cinder-quobyte-b2284535-bcc9-48d1-9214-90a16a12b670" released by "delete_volume" :: held 2.017s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:03:30 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] Created reservations ['b520c9d9-25cf-495c-b901-e46e062e30a8', '79eb8ab6-4707-4759-9cc7-95fc8bb88a3b', 'd2b012a3-f8e8-49eb-8b77-57cb2453c85a', '06405645-fb26-4f75-a23b-a46576308bbc'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:03:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:03:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:03:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:03:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:03:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:03:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:30 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:03:30 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Flow 'volume_create_manager' (f028eaef-094a-429a-8fb1-39358d87ebfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3339f3-96aa-4d75-bf32-7c96a2d6c9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3339f3-96aa-4d75-bf32-7c96a2d6c9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1384947440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4991350-3783-43fb-9267-c9ff15806149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6ccfd420494ccdaebe6e3887f6bfd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:31Z,use_quota=True,user_id='c3f235a4b50342a191792169d45b414f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3aa5b0-e67a-4dd5-b900-6d57c3effbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3aa5b0-e67a-4dd5-b900-6d57c3effbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8365b202-6c65-427e-a6bb-8d31bc251bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8365b202-6c65-427e-a6bb-8d31bc251bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4991350-3783-43fb-9267-c9ff15806149', 'volume_name': 'volume-f4991350-3783-43fb-9267-c9ff15806149', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50644b6-2cae-4672-8246-b39f6c14c1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50644b6-2cae-4672-8246-b39f6c14c1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b1d567-ec5b-47b0-973e-c3ae4d24aa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:03:31 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Volume f4991350-3783-43fb-9267-c9ff15806149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4991350-3783-43fb-9267-c9ff15806149', 'volume_size': 1} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1384947440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4991350-3783-43fb-9267-c9ff15806149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6ccfd420494ccdaebe6e3887f6bfd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:31Z,use_quota=True,user_id='c3f235a4b50342a191792169d45b414f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Creating volume f4991350-3783-43fb-9267-c9ff15806149 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:03:31 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4991350-3783-43fb-9267-c9ff15806149 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:31 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4991350-3783-43fb-9267-c9ff15806149 1073741824 Jul 04 00:03:31 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:31 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.124s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:03:31 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] Deleted volume successfully. Jul 04 00:03:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f59eca0f-3e15-40e6-a586-324f38e069ab tempest-ProjectReaderTests-381090088 None] Lock "cinder-b2284535-bcc9-48d1-9214-90a16a12b670-delete_volume" released by "delete_volume" :: held 3.517s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:03:32 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4991350-3783-43fb-9267-c9ff15806149 1073741824" returned: 0 in 1.062s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4991350-3783-43fb-9267-c9ff15806149 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:32 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4991350-3783-43fb-9267-c9ff15806149 Jul 04 00:03:32 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:33 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4991350-3783-43fb-9267-c9ff15806149" returned: 0 in 0.793s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:03:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:03:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:03:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:03:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:03:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:03:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b1d567-ec5b-47b0-973e-c3ae4d24aa26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4991350-3783-43fb-9267-c9ff15806149', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0b76d5-21b9-4ca5-af65-270287bfb503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:03:33 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:03:33 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:33 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Volume volume-f4991350-3783-43fb-9267-c9ff15806149 (f4991350-3783-43fb-9267-c9ff15806149): created successfully Jul 04 00:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0b76d5-21b9-4ca5-af65-270287bfb503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Flow 'volume_create_manager' (f028eaef-094a-429a-8fb1-39358d87ebfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:03:33 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c34911c6-774f-45b1-b069-8e111ce85c04 tempest-ProjectReaderTests-381090088 None] Created volume successfully. Jul 04 00:03:34 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.749s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:03:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:03:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] Acquiring lock "cinder-f4991350-3783-43fb-9267-c9ff15806149-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:03:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] Lock "cinder-f4991350-3783-43fb-9267-c9ff15806149-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:03:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] Acquiring lock "cinder-quobyte-f4991350-3783-43fb-9267-c9ff15806149" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:03:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] Lock "cinder-quobyte-f4991350-3783-43fb-9267-c9ff15806149" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:03:34 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d41ace-e4fa-47db-9411-7ef590fae528]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:03:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4991350-3783-43fb-9267-c9ff15806149 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:34 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4991350-3783-43fb-9267-c9ff15806149 Jul 04 00:03:34 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:35 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4991350-3783-43fb-9267-c9ff15806149" returned: 0 in 0.935s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4991350-3783-43fb-9267-c9ff15806149 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:35 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4991350-3783-43fb-9267-c9ff15806149 Jul 04 00:03:35 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] Acquiring lock "cinder-0b64d7d2-db19-4d09-bfd6-8061bfeb3487-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:03:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] Lock "cinder-0b64d7d2-db19-4d09-bfd6-8061bfeb3487-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:03:36 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=58,cinder:INSERT=30,cinder:UPDATE=81,cinder:DELETE=8 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:03:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] Acquiring lock "cinder-quobyte-0b64d7d2-db19-4d09-bfd6-8061bfeb3487" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:03:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] Lock "cinder-quobyte-0b64d7d2-db19-4d09-bfd6-8061bfeb3487" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:03:36 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bc463f-2e8c-4805-b2f6-81f99ba0f582]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:03:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0b64d7d2-db19-4d09-bfd6-8061bfeb3487 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:36 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0b64d7d2-db19-4d09-bfd6-8061bfeb3487 Jul 04 00:03:36 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:36 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f4991350-3783-43fb-9267-c9ff15806149" returned: 0 in 0.751s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] Lock "cinder-quobyte-f4991350-3783-43fb-9267-c9ff15806149" released by "delete_volume" :: held 1.751s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:03:36 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] Created reservations ['99a675f6-ed2f-42b6-a36a-71afc5880b59', 'd5762083-0ea2-4999-9242-4198cdda3844', '8e63e209-b6b8-47e2-b410-fa2136624de8', '293a558c-cf2b-47c2-9f3c-9739d5e4cf7c'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:03:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:03:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:03:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:03:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:03:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:03:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:36 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:03:36 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:37 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0b64d7d2-db19-4d09-bfd6-8061bfeb3487" returned: 0 in 1.086s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0b64d7d2-db19-4d09-bfd6-8061bfeb3487 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:37 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0b64d7d2-db19-4d09-bfd6-8061bfeb3487 Jul 04 00:03:37 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:37 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.923s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:37 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:03:37 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] Deleted volume successfully. Jul 04 00:03:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b9a443b6-46f5-4e2f-be91-abf609e2a671 tempest-ProjectReaderTests-381090088 None] Lock "cinder-f4991350-3783-43fb-9267-c9ff15806149-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:03:38 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-0b64d7d2-db19-4d09-bfd6-8061bfeb3487" returned: 0 in 0.790s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] Lock "cinder-quobyte-0b64d7d2-db19-4d09-bfd6-8061bfeb3487" released by "delete_volume" :: held 1.917s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:03:38 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] Created reservations ['41b652bd-4895-45bc-8096-f272e85d8f64', 'bc7168b9-ccee-43c9-a5ca-8ae7f308aa26', 'c4431cfe-0e3e-4553-b258-1809f89ddd00', 'ac9fa1f8-25da-471d-914d-e5b3624f1ef2'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:03:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:03:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:03:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:03:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:03:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:03:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:38 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:03:38 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:39 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.041s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:03:39 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] Deleted volume successfully. Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fbebceab-aa0f-4a93-a720-21b6580e2dbb tempest-VolumesNegativeTest-756361154 None] Lock "cinder-0b64d7d2-db19-4d09-bfd6-8061bfeb3487-delete_volume" released by "delete_volume" :: held 3.385s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Flow 'volume_create_manager' (f20b5f12-c1a5-4c09-8fdd-6509f3df94d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd15ff8-d1d9-425f-87e9-ee9b47f3741f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd15ff8-d1d9-425f-87e9-ee9b47f3741f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1977305831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4ba26e-2043-4840-9e2e-b4f440610b2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a99dbddadc4c85af08f820ea5e4576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:39Z,use_quota=True,user_id='d0d1ba8c15354946878a27112f9c2100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7da1cc-e3ea-4e1d-b02a-b1c4ef0fe396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7da1cc-e3ea-4e1d-b02a-b1c4ef0fe396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ede881-aebd-448c-bcd7-70105885d01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ede881-aebd-448c-bcd7-70105885d01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab4ba26e-2043-4840-9e2e-b4f440610b2f', 'volume_name': 'volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3238c34f-ec0d-4e2f-bb0b-d4bebd90c4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3238c34f-ec0d-4e2f-bb0b-d4bebd90c4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede87519-e901-4adf-ada5-2ccf58466361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:03:39 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Volume ab4ba26e-2043-4840-9e2e-b4f440610b2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f', 'volume_size': 1} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1977305831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4ba26e-2043-4840-9e2e-b4f440610b2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a99dbddadc4c85af08f820ea5e4576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:39Z,use_quota=True,user_id='d0d1ba8c15354946878a27112f9c2100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Creating volume ab4ba26e-2043-4840-9e2e-b4f440610b2f {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:03:39 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:03:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:39 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f 1073741824 Jul 04 00:03:39 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:40 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f 1073741824" returned: 0 in 0.965s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:40 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f Jul 04 00:03:40 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:41 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f" returned: 0 in 0.716s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:03:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:03:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede87519-e901-4adf-ada5-2ccf58466361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:03:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af19c84-adab-4af0-9277-3dd33bc05f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:03:41 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Volume volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f (ab4ba26e-2043-4840-9e2e-b4f440610b2f): created successfully Jul 04 00:03:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af19c84-adab-4af0-9277-3dd33bc05f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:03:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Flow 'volume_create_manager' (f20b5f12-c1a5-4c09-8fdd-6509f3df94d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:03:41 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b91d98cb-3c6b-46dc-83b1-a8ad2596cc45 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Created volume successfully. Jul 04 00:03:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-894d47e3-46de-418b-86a3-597129e3afb7 req-05cec3a3-b033-4600-85be-7ff7c02e5796 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:03:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-894d47e3-46de-418b-86a3-597129e3afb7 req-05cec3a3-b033-4600-85be-7ff7c02e5796 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:03:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04d7258-5143-4110-9a29-732e2e941e65]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:03:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-894d47e3-46de-418b-86a3-597129e3afb7 req-05cec3a3-b033-4600-85be-7ff7c02e5796 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:46 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f Jul 04 00:03:46 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:47 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-894d47e3-46de-418b-86a3-597129e3afb7 req-05cec3a3-b033-4600-85be-7ff7c02e5796 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f" returned: 0 in 0.928s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-894d47e3-46de-418b-86a3-597129e3afb7 req-05cec3a3-b033-4600-85be-7ff7c02e5796 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.951s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:03:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-894d47e3-46de-418b-86a3-597129e3afb7 req-05cec3a3-b033-4600-85be-7ff7c02e5796 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '431a8ac1-cc15-4901-94ce-abe85b2f3d65', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 04 00:03:47 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-894d47e3-46de-418b-86a3-597129e3afb7 req-05cec3a3-b033-4600-85be-7ff7c02e5796 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] attachment_update completed successfully. Jul 04 00:03:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-667a8f6e-5f5f-438e-85b3-be2a68867ede req-88641af0-57f2-4f64-af96-ae98cc9a1ec6 tempest-TestInstancesWithCinderVolumes-161535330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:03:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-667a8f6e-5f5f-438e-85b3-be2a68867ede req-88641af0-57f2-4f64-af96-ae98cc9a1ec6 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:03:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8a6d57-82db-45be-8cd0-4d4278df2f8b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:03:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-667a8f6e-5f5f-438e-85b3-be2a68867ede req-88641af0-57f2-4f64-af96-ae98cc9a1ec6 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e813404e-79ce-4b06-9617-776671b5d1ed {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:53 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e813404e-79ce-4b06-9617-776671b5d1ed Jul 04 00:03:53 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:54 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-667a8f6e-5f5f-438e-85b3-be2a68867ede req-88641af0-57f2-4f64-af96-ae98cc9a1ec6 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e813404e-79ce-4b06-9617-776671b5d1ed" returned: 0 in 0.850s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-667a8f6e-5f5f-438e-85b3-be2a68867ede req-88641af0-57f2-4f64-af96-ae98cc9a1ec6 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.868s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:03:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-667a8f6e-5f5f-438e-85b3-be2a68867ede req-88641af0-57f2-4f64-af96-ae98cc9a1ec6 tempest-TestInstancesWithCinderVolumes-161535330 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-e813404e-79ce-4b06-9617-776671b5d1ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41fc93bf-cbd6-4a10-9a70-f29abf2c3049', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 04 00:03:54 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-667a8f6e-5f5f-438e-85b3-be2a68867ede req-88641af0-57f2-4f64-af96-ae98cc9a1ec6 tempest-TestInstancesWithCinderVolumes-161535330 None] attachment_update completed successfully. Jul 04 00:03:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-e7515785-7f82-4a6b-aa82-fd5003bdb19e req-8ba2ec7a-9ff0-4fcd-9867-ac2b9277085c tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Terminate volume connection completed successfully. Jul 04 00:03:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-e7515785-7f82-4a6b-aa82-fd5003bdb19e req-8ba2ec7a-9ff0-4fcd-9867-ac2b9277085c tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Deleting attachment 431a8ac1-cc15-4901-94ce-abe85b2f3d65. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 04 00:03:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Acquiring lock "cinder-ab4ba26e-2043-4840-9e2e-b4f440610b2f-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:03:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Lock "cinder-ab4ba26e-2043-4840-9e2e-b4f440610b2f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:03:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Acquiring lock "cinder-quobyte-ab4ba26e-2043-4840-9e2e-b4f440610b2f" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:03:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Lock "cinder-quobyte-ab4ba26e-2043-4840-9e2e-b4f440610b2f" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:03:57 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[523b3b7e-e848-4e06-9efa-983b419cf4fd]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:03:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:57 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f Jul 04 00:03:57 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:58 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f" returned: 0 in 0.897s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:58 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f Jul 04 00:03:58 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:03:58 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Jul 04 00:03:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ab4ba26e-2043-4840-9e2e-b4f440610b2f" returned: 0 in 0.715s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:03:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Lock "cinder-quobyte-ab4ba26e-2043-4840-9e2e-b4f440610b2f" released by "delete_volume" :: held 1.665s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:03:59 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Created reservations ['24372fc0-8a1a-471d-b233-2252b8da4203', 'f3b0114a-cf21-47d9-ba0a-32e6d772357f', 'c29757b8-b5a9-4337-9f06-928804762454', 'b7f33d78-3118-467a-b5f9-aae76ec32462'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:03:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:03:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:03:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:03:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:03:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:03:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:03:59 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:03:59 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:00 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.957s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:00 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:04:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Deleted volume successfully. Jul 04 00:04:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-65a0db36-4fc8-4a17-b82c-eeae887835f1 tempest-TestServerVolumeAttachScenarioOldVersion-322031114 None] Lock "cinder-ab4ba26e-2043-4840-9e2e-b4f440610b2f-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:04:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-ff5643e3-3d4a-47a9-b5cc-61ab01e2d61e req-3861bb3f-99a9-41c3-9ccf-1e0f5a1ac70f tempest-TestInstancesWithCinderVolumes-161535330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:04:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-ff5643e3-3d4a-47a9-b5cc-61ab01e2d61e req-3861bb3f-99a9-41c3-9ccf-1e0f5a1ac70f tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:04:02 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1c5a9a-e36b-49ed-ace2-e76b7502c6ae]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:04:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-ff5643e3-3d4a-47a9-b5cc-61ab01e2d61e req-3861bb3f-99a9-41c3-9ccf-1e0f5a1ac70f tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82e2bacb-1746-4a46-b469-8f46e3565f29 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:02 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82e2bacb-1746-4a46-b469-8f46e3565f29 Jul 04 00:04:02 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:03 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-ff5643e3-3d4a-47a9-b5cc-61ab01e2d61e req-3861bb3f-99a9-41c3-9ccf-1e0f5a1ac70f tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82e2bacb-1746-4a46-b469-8f46e3565f29" returned: 0 in 0.989s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-ff5643e3-3d4a-47a9-b5cc-61ab01e2d61e req-3861bb3f-99a9-41c3-9ccf-1e0f5a1ac70f tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.019s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:04:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-ff5643e3-3d4a-47a9-b5cc-61ab01e2d61e req-3861bb3f-99a9-41c3-9ccf-1e0f5a1ac70f tempest-TestInstancesWithCinderVolumes-161535330 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-82e2bacb-1746-4a46-b469-8f46e3565f29', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7abf3da9-6194-490b-860b-2cd16ebda16a', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 04 00:04:03 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-ff5643e3-3d4a-47a9-b5cc-61ab01e2d61e req-3861bb3f-99a9-41c3-9ccf-1e0f5a1ac70f tempest-TestInstancesWithCinderVolumes-161535330 None] attachment_update completed successfully. Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Flow 'volume_create_manager' (11c46ce1-b798-417d-8de1-3af0c464c2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24c3a40-2232-4868-9ef6-267997f6d61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24c3a40-2232-4868-9ef6-267997f6d61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-285926900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e68484f-87a9-4b70-952c-72f4f9e33e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db5c8bd306d4a24bbdb822da2bf592b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:06Z,use_quota=True,user_id='395e8643879646678a312d98bf0593a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab870bf-7a4c-47e9-b7e0-1533ec7ef6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab870bf-7a4c-47e9-b7e0-1533ec7ef6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1121d10-5ed5-4358-89a3-5d62ed94c527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1121d10-5ed5-4358-89a3-5d62ed94c527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e68484f-87a9-4b70-952c-72f4f9e33e5d', 'volume_name': 'volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4f81ac-9a58-47c0-b0e4-221a3b5953d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4f81ac-9a58-47c0-b0e4-221a3b5953d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7996387-2869-46e0-95c4-ada282bd066b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:06 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Volume 3e68484f-87a9-4b70-952c-72f4f9e33e5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d', 'volume_size': 1} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-285926900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e68484f-87a9-4b70-952c-72f4f9e33e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db5c8bd306d4a24bbdb822da2bf592b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:06Z,use_quota=True,user_id='395e8643879646678a312d98bf0593a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Creating volume 3e68484f-87a9-4b70-952c-72f4f9e33e5d {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:04:06 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:06 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d 1073741824 Jul 04 00:04:06 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Flow 'volume_create_manager' (c697bdad-dd31-497b-85cb-be2b5c69c26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65dd8edf-d70a-466f-bf70-ffd4d9dc323f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65dd8edf-d70a-466f-bf70-ffd4d9dc323f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-450316385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cca665-8338-46bc-ba0b-2c20146bae4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db5c8bd306d4a24bbdb822da2bf592b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:07Z,use_quota=True,user_id='395e8643879646678a312d98bf0593a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379bbdc8-3805-4197-9185-39493f3d9aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379bbdc8-3805-4197-9185-39493f3d9aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac594286-f96f-4acc-b7cb-12de25dbad1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac594286-f96f-4acc-b7cb-12de25dbad1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0cca665-8338-46bc-ba0b-2c20146bae4a', 'volume_name': 'volume-f0cca665-8338-46bc-ba0b-2c20146bae4a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0547f4-21f6-47ff-bfb2-f985f97918b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0547f4-21f6-47ff-bfb2-f985f97918b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db82a0f9-9aea-4336-90e8-060966bdbe8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:06 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Volume f0cca665-8338-46bc-ba0b-2c20146bae4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0cca665-8338-46bc-ba0b-2c20146bae4a', 'volume_size': 1} Jul 04 00:04:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:04:07 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d 1073741824" returned: 0 in 1.141s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:07 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d Jul 04 00:04:07 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:08 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d" returned: 0 in 0.763s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:04:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:04:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.548s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:04:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-450316385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cca665-8338-46bc-ba0b-2c20146bae4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db5c8bd306d4a24bbdb822da2bf592b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:07Z,use_quota=True,user_id='395e8643879646678a312d98bf0593a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:04:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Creating volume f0cca665-8338-46bc-ba0b-2c20146bae4a {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:04:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:04:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:04:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:04:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:04:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:04:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:04:08 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:04:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f0cca665-8338-46bc-ba0b-2c20146bae4a 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:08 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f0cca665-8338-46bc-ba0b-2c20146bae4a 1073741824 Jul 04 00:04:08 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7996387-2869-46e0-95c4-ada282bd066b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04fa542a-6561-40f6-a685-d29bc8129bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:08 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Volume volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d (3e68484f-87a9-4b70-952c-72f4f9e33e5d): created successfully Jul 04 00:04:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04fa542a-6561-40f6-a685-d29bc8129bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Flow 'volume_create_manager' (11c46ce1-b798-417d-8de1-3af0c464c2ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:04:08 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ff949f7a-d951-4dac-90d2-74b4638e78f2 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Created volume successfully. Jul 04 00:04:09 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f0cca665-8338-46bc-ba0b-2c20146bae4a 1073741824" returned: 0 in 1.220s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f0cca665-8338-46bc-ba0b-2c20146bae4a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:09 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f0cca665-8338-46bc-ba0b-2c20146bae4a Jul 04 00:04:09 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:10 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f0cca665-8338-46bc-ba0b-2c20146bae4a" returned: 0 in 0.909s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] <== create_volume: return (2185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:04:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.189s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:04:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db82a0f9-9aea-4336-90e8-060966bdbe8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0cca665-8338-46bc-ba0b-2c20146bae4a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad95dc1-816a-49d7-87d3-f3b6dac2b9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:10 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Volume volume-f0cca665-8338-46bc-ba0b-2c20146bae4a (f0cca665-8338-46bc-ba0b-2c20146bae4a): created successfully Jul 04 00:04:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad95dc1-816a-49d7-87d3-f3b6dac2b9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Flow 'volume_create_manager' (c697bdad-dd31-497b-85cb-be2b5c69c26f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:04:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f5e4f8b1-1b85-4e61-931c-444171b6ca5e tempest-TestServerVolumeAttachmentScenario-1460773637 None] Created volume successfully. Jul 04 00:04:14 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-9462435e-f712-40ac-a6d5-9ff4f3185374 req-3888d0f4-67c4-43ec-97f2-1d40def22966 tempest-TestInstancesWithCinderVolumes-161535330 None] Terminate volume connection completed successfully. Jul 04 00:04:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-9462435e-f712-40ac-a6d5-9ff4f3185374 req-3888d0f4-67c4-43ec-97f2-1d40def22966 tempest-TestInstancesWithCinderVolumes-161535330 None] Deleting attachment 41fc93bf-cbd6-4a10-9a70-f29abf2c3049. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 04 00:04:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] Acquiring lock "cinder-e813404e-79ce-4b06-9617-776671b5d1ed-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:04:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "cinder-e813404e-79ce-4b06-9617-776671b5d1ed-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:04:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] Acquiring lock "cinder-quobyte-e813404e-79ce-4b06-9617-776671b5d1ed" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:04:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "cinder-quobyte-e813404e-79ce-4b06-9617-776671b5d1ed" acquired by "delete_volume" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:04:16 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[474f57c1-ca19-44a6-9333-99cc3b65f300]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:04:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e813404e-79ce-4b06-9617-776671b5d1ed {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:17 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e813404e-79ce-4b06-9617-776671b5d1ed Jul 04 00:04:17 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:17 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e813404e-79ce-4b06-9617-776671b5d1ed" returned: 0 in 1.039s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e813404e-79ce-4b06-9617-776671b5d1ed {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:17 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e813404e-79ce-4b06-9617-776671b5d1ed Jul 04 00:04:17 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:18 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e813404e-79ce-4b06-9617-776671b5d1ed" returned: 0 in 0.991s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "cinder-quobyte-e813404e-79ce-4b06-9617-776671b5d1ed" released by "delete_volume" :: held 2.110s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:04:18 devstack cinder-volume[86676]: WARNING cinder.quota [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-156790679-1995730330 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-156790679-1995730330, it is now deprecated. Please use the default quota class for default quota. Jul 04 00:04:18 devstack cinder-volume[86676]: WARNING cinder.quota [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-156790679-1995730330 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-156790679-1995730330, it is now deprecated. Please use the default quota class for default quota. Jul 04 00:04:19 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] Created reservations ['56f271ac-bee2-45fb-87ad-7f770bdf3077', 'c4371f4d-e055-4172-856e-3649c37c5a73', '2b39f24e-27f2-4795-80f0-84d335cc7dc5', 'a5b571a1-d1fd-4715-b40c-4b1c4284dd9a'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:04:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:04:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:04:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:04:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:04:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:04:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:19 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:04:19 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:20 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.838s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:20 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:04:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] Deleted volume successfully. Jul 04 00:04:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed57c5e1-3ad0-42b3-b3d9-87fb8cc3f101 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "cinder-e813404e-79ce-4b06-9617-776671b5d1ed-delete_volume" released by "delete_volume" :: held 3.299s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:04:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-92cce25d-c257-4a1b-bc5a-4f194f99bd3d req-f8aacaf4-0448-4e3d-97c2-0bc094d6e128 tempest-TestInstancesWithCinderVolumes-161535330 None] Terminate volume connection completed successfully. Jul 04 00:04:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-92cce25d-c257-4a1b-bc5a-4f194f99bd3d req-f8aacaf4-0448-4e3d-97c2-0bc094d6e128 tempest-TestInstancesWithCinderVolumes-161535330 None] Deleting attachment 7abf3da9-6194-490b-860b-2cd16ebda16a. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 04 00:04:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] Acquiring lock "cinder-82e2bacb-1746-4a46-b469-8f46e3565f29-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:04:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "cinder-82e2bacb-1746-4a46-b469-8f46e3565f29-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:04:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] Acquiring lock "cinder-quobyte-82e2bacb-1746-4a46-b469-8f46e3565f29" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:04:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "cinder-quobyte-82e2bacb-1746-4a46-b469-8f46e3565f29" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:04:24 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77b6564-a156-497c-a7ea-23f9aac50344]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:04:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82e2bacb-1746-4a46-b469-8f46e3565f29 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:24 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82e2bacb-1746-4a46-b469-8f46e3565f29 Jul 04 00:04:24 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:24 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:04:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Flow 'volume_create_manager' (55a18919-cafc-4e0b-a42c-f10d4b05ffa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2f70e6-7ca8-44c7-967d-17855a0a8bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2f70e6-7ca8-44c7-967d-17855a0a8bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f1c74c-7845-46a9-b0db-ccce25633750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51007c47f39e47f0bb6f0e4c18c8997f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:25Z,use_quota=True,user_id='d32dd489133e4e55a789bd9e0b1b66f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00132487-2858-46b2-936c-92a499b134f2),volume_type_id=00132487-2858-46b2-936c-92a499b134f2)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7d06dd-bb41-4d76-89d9-b13968c96ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7d06dd-bb41-4d76-89d9-b13968c96ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cdec909-12fc-4969-985c-16611639de52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:25 devstack cinder-volume[86676]: DEBUG cinder.image.glance [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Creating Keystone auth plugin from conf {{(pid=86676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 04 00:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cdec909-12fc-4969-985c-16611639de52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '90f1c74c-7845-46a9-b0db-ccce25633750', 'volume_name': 'volume-90f1c74c-7845-46a9-b0db-ccce25633750', 'volume_size': 1, 'image_id': '4d8f805f-139e-4f04-a5b0-43448bb8890d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d8f805f-139e-4f04-a5b0-43448bb8890d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a9044c28e22b6a8be7b951e1b453970b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '51007c47f39e47f0bb6f0e4c18c8997f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '72274b437f18fc9ab0acf7be79d9e601424ff19b6001fd7fead42fc602e9aa94450227cdb4f0ac8429d62d02449459b98a50715b41fc3b34711fce04b65613d1', 'id': '4d8f805f-139e-4f04-a5b0-43448bb8890d', 'created_at': datetime.datetime(2026, 7, 3, 22, 4, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 4, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d8f805f-139e-4f04-a5b0-43448bb8890d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a6eee5-39ba-4332-bcc4-69a9db72dcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a6eee5-39ba-4332-bcc4-69a9db72dcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541e971c-df11-4af2-bd72-3ed3358685ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:25 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Volume 90f1c74c-7845-46a9-b0db-ccce25633750: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-90f1c74c-7845-46a9-b0db-ccce25633750', 'volume_size': 1, 'image_id': '4d8f805f-139e-4f04-a5b0-43448bb8890d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d8f805f-139e-4f04-a5b0-43448bb8890d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a9044c28e22b6a8be7b951e1b453970b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '51007c47f39e47f0bb6f0e4c18c8997f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '72274b437f18fc9ab0acf7be79d9e601424ff19b6001fd7fead42fc602e9aa94450227cdb4f0ac8429d62d02449459b98a50715b41fc3b34711fce04b65613d1', 'id': '4d8f805f-139e-4f04-a5b0-43448bb8890d', 'created_at': datetime.datetime(2026, 7, 3, 22, 4, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 4, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d8f805f-139e-4f04-a5b0-43448bb8890d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 04 00:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Trying to clone 90f1c74c-7845-46a9-b0db-ccce25633750 from image 4d8f805f-139e-4f04-a5b0-43448bb8890d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d8f805f-139e-4f04-a5b0-43448bb8890d', 'metadata': {}}]). {{(pid=86676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 04 00:04:25 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82e2bacb-1746-4a46-b469-8f46e3565f29" returned: 0 in 0.978s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82e2bacb-1746-4a46-b469-8f46e3565f29 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:25 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 04 00:04:25 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Image download 0.00 MB at 0.00 MB/s Jul 04 00:04:25 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82e2bacb-1746-4a46-b469-8f46e3565f29 Jul 04 00:04:25 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:25 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[943a9f15-e3f3-4edc-b579-1cadd133f1f3]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:04:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:25 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD Jul 04 00:04:25 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:26 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-82e2bacb-1746-4a46-b469-8f46e3565f29" returned: 0 in 1.064s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "cinder-quobyte-82e2bacb-1746-4a46-b469-8f46e3565f29" released by "delete_volume" :: held 2.092s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:04:26 devstack cinder-volume[86676]: WARNING cinder.quota [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-638212509-1780056048 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-638212509-1780056048, it is now deprecated. Please use the default quota class for default quota. Jul 04 00:04:26 devstack cinder-volume[86676]: WARNING cinder.quota [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-638212509-1780056048 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-638212509-1780056048, it is now deprecated. Please use the default quota class for default quota. Jul 04 00:04:26 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD" returned: 0 in 1.087s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:26 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] Created reservations ['a8aa0c23-13c6-460c-a742-d27a478e1383', '63d34491-5a43-4f9c-8c37-afc3b75703b0', '6a98f91a-76d4-4e1f-a6f9-bef275d64793', '61b70766-e8e7-41fb-b02a-4720abeecb05'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:04:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:04:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:04:26 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD Jul 04 00:04:26 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:04:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:04:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:26 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:04:26 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:28 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.079s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:28 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:04:28 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] Deleted volume successfully. Jul 04 00:04:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6af380a5-54f9-4fe9-8f13-c5bc8383b69b tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "cinder-82e2bacb-1746-4a46-b469-8f46e3565f29-delete_volume" released by "delete_volume" :: held 3.659s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:04:28 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD" returned: 1 in 1.541s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:04:28 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Temporary image 4d8f805f-139e-4f04-a5b0-43448bb8890d is fetched for user d32dd489133e4e55a789bd9e0b1b66f7. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 04 00:04:28 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=55,cinder:INSERT=12,cinder:UPDATE=61,cinder:DELETE=4 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:04:28 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1452dd-63fa-406a-a4fc-d68c8a52ae91]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:04:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:28 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD Jul 04 00:04:28 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:29 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD" returned: 0 in 0.890s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:29 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD Jul 04 00:04:29 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:30 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD" returned: 1 in 1.077s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:04:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:04:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:04:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f1c74c-7845-46a9-b0db-ccce25633750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51007c47f39e47f0bb6f0e4c18c8997f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:25Z,use_quota=True,user_id='d32dd489133e4e55a789bd9e0b1b66f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00132487-2858-46b2-936c-92a499b134f2),volume_type_id=00132487-2858-46b2-936c-92a499b134f2)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:04:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Creating volume 90f1c74c-7845-46a9-b0db-ccce25633750 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:04:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:04:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:04:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:04:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:04:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:04:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:04:30 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:04:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:30 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 1073741824 Jul 04 00:04:30 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:31 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 1073741824" returned: 0 in 1.164s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:31 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 Jul 04 00:04:31 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:32 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750" returned: 0 in 0.759s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:04:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Attempting download of 4d8f805f-139e-4f04-a5b0-43448bb8890d ((None, [{'url': 'file:///opt/stack/data/glance/images/4d8f805f-139e-4f04-a5b0-43448bb8890d', 'metadata': {}}])) to volume 90f1c74c-7845-46a9-b0db-ccce25633750. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 04 00:04:32 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f6bdaf-0bff-4fad-a0b4-03fe65d0460c]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:04:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d8f805f-139e-4f04-a5b0-43448bb8890d_kr2qnr8_ {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:32 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d8f805f-139e-4f04-a5b0-43448bb8890d_kr2qnr8_ Jul 04 00:04:32 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:32 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-09a6022c-5dcf-4206-ba8c-182861541261 req-655fa778-23c8-48d6-a992-358c3af05111 tempest-TestInstancesWithCinderVolumes-161535330 None] Terminate volume connection completed successfully. Jul 04 00:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-09a6022c-5dcf-4206-ba8c-182861541261 req-655fa778-23c8-48d6-a992-358c3af05111 tempest-TestInstancesWithCinderVolumes-161535330 None] Deleting attachment fc031468-ed5f-492d-9841-ccd230dc2bcb. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 04 00:04:33 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d8f805f-139e-4f04-a5b0-43448bb8890d_kr2qnr8_" returned: 0 in 0.782s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d8f805f-139e-4f04-a5b0-43448bb8890d_kr2qnr8_ {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:33 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d8f805f-139e-4f04-a5b0-43448bb8890d_kr2qnr8_ Jul 04 00:04:33 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:04:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:04:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:04:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:04:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:33 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:04:33 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:34 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d8f805f-139e-4f04-a5b0-43448bb8890d_kr2qnr8_" returned: 1 in 0.950s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d8f805f-139e-4f04-a5b0-43448bb8890d_kr2qnr8_' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:04:34 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[feaf5417-feea-4e78-817d-32f165f19fe2]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:04:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:34 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.812s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:04:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:04:34 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD Jul 04 00:04:34 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:34 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD" returned: 0 in 0.741s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:35 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD Jul 04 00:04:35 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:35 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD" returned: 1 in 0.740s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:04:35 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] 4d8f805f-139e-4f04-a5b0-43448bb8890d was raw, converting to raw {{(pid=86676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 04 00:04:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:35 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 Jul 04 00:04:35 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Acquiring lock "cinder-30a4ca73-24ab-47d5-850b-0cd15f2eefe1-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:04:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "cinder-30a4ca73-24ab-47d5-850b-0cd15f2eefe1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:04:36 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=57,cinder:INSERT=15,cinder:UPDATE=60,cinder:DELETE=6 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:04:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Acquiring lock "cinder-quobyte-30a4ca73-24ab-47d5-850b-0cd15f2eefe1" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:04:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "cinder-quobyte-30a4ca73-24ab-47d5-850b-0cd15f2eefe1" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:04:36 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[661e3607-0247-4d5d-b3eb-8c05d2b79ffe]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:04:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:36 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 Jul 04 00:04:36 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:36 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750" returned: 0 in 0.801s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:36 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d8f805f-139e-4f04-a5b0-43448bb8890d_tlejj64zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 04 00:04:36 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Converted 0.00 MB image at 0.00 MB/s Jul 04 00:04:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:36 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 1G Jul 04 00:04:36 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:37 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1" returned: 0 in 0.800s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:37 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 1G" returned: 0 in 0.708s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:37 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[949a7fcf-0f90-4ff0-90cd-db9d0aa66b3b]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:04:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:37 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 Jul 04 00:04:37 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:37 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 Jul 04 00:04:37 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:37 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1" returned: 1 in 0.807s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:04:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:37 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750" returned: 0 in 0.748s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:37 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1 Jul 04 00:04:37 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:38 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 Jul 04 00:04:38 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:38 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a4ca73-24ab-47d5-850b-0cd15f2eefe1" returned: 0 in 0.753s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "cinder-quobyte-30a4ca73-24ab-47d5-850b-0cd15f2eefe1" released by "delete_volume" :: held 2.433s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:04:38 devstack cinder-volume[86676]: WARNING cinder.quota [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1377062759-2034516637 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1377062759-2034516637, it is now deprecated. Please use the default quota class for default quota. Jul 04 00:04:38 devstack cinder-volume[86676]: WARNING cinder.quota [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1377062759-2034516637 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1377062759-2034516637, it is now deprecated. Please use the default quota class for default quota. Jul 04 00:04:38 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750" returned: 1 in 0.813s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Downloaded image 4d8f805f-139e-4f04-a5b0-43448bb8890d ((None, [{'url': 'file:///opt/stack/data/glance/images/4d8f805f-139e-4f04-a5b0-43448bb8890d', 'metadata': {}}])) to volume 90f1c74c-7845-46a9-b0db-ccce25633750 successfully. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Temporary image 4d8f805f-139e-4f04-a5b0-43448bb8890d for user d32dd489133e4e55a789bd9e0b1b66f7 is deleted. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Marking volume 90f1c74c-7845-46a9-b0db-ccce25633750 as bootable. {{(pid=86676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Created reservations ['88f6e562-8cc1-4d10-b0c1-c9a71275765f', 'b8265109-972f-4ec0-b017-d49d0205c2fe', 'ffbeef13-4ce0-4828-b7bd-4f4ce5ba3a3a', '79336e2c-ea89-43ef-a8c5-877e4d7899ff'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Copying metadata from image 4d8f805f-139e-4f04-a5b0-43448bb8890d to 90f1c74c-7845-46a9-b0db-ccce25633750. {{(pid=86676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Creating volume glance metadata for volume 90f1c74c-7845-46a9-b0db-ccce25633750 backed by image 4d8f805f-139e-4f04-a5b0-43448bb8890d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4d8f805f-139e-4f04-a5b0-43448bb8890d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a9044c28e22b6a8be7b951e1b453970b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541e971c-df11-4af2-bd72-3ed3358685ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90f1c74c-7845-46a9-b0db-ccce25633750', 'volume_size': 1, 'image_id': '4d8f805f-139e-4f04-a5b0-43448bb8890d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d8f805f-139e-4f04-a5b0-43448bb8890d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a9044c28e22b6a8be7b951e1b453970b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '51007c47f39e47f0bb6f0e4c18c8997f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '72274b437f18fc9ab0acf7be79d9e601424ff19b6001fd7fead42fc602e9aa94450227cdb4f0ac8429d62d02449459b98a50715b41fc3b34711fce04b65613d1', 'id': '4d8f805f-139e-4f04-a5b0-43448bb8890d', 'created_at': datetime.datetime(2026, 7, 3, 22, 4, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 4, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d8f805f-139e-4f04-a5b0-43448bb8890d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:38 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:04:38 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527b8525-ff55-4103-8ae8-9e68780f8538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Volume volume-90f1c74c-7845-46a9-b0db-ccce25633750 (90f1c74c-7845-46a9-b0db-ccce25633750): created successfully Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527b8525-ff55-4103-8ae8-9e68780f8538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Flow 'volume_create_manager' (55a18919-cafc-4e0b-a42c-f10d4b05ffa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:04:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-471dafc3-e73b-4e04-8309-0c51814a3e08 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Created volume successfully. Jul 04 00:04:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Acquiring lock "cinder-90f1c74c-7845-46a9-b0db-ccce25633750-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:04:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Lock "cinder-90f1c74c-7845-46a9-b0db-ccce25633750-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:04:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Acquiring lock "cinder-quobyte-90f1c74c-7845-46a9-b0db-ccce25633750" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:04:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Lock "cinder-quobyte-90f1c74c-7845-46a9-b0db-ccce25633750" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:04:39 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb20b01-a806-4ef8-b2f3-27bb122ba881]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:04:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:39 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 Jul 04 00:04:39 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:39 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.713s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:39 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:04:39 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Deleted volume successfully. Jul 04 00:04:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6dd6eb89-a439-4c52-9778-15fa8ac3fe87 tempest-TestInstancesWithCinderVolumes-161535330 None] Lock "cinder-30a4ca73-24ab-47d5-850b-0cd15f2eefe1-delete_volume" released by "delete_volume" :: held 3.456s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:04:40 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750" returned: 0 in 0.852s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:40 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 Jul 04 00:04:40 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:41 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750" returned: 1 in 0.834s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:41 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750 Jul 04 00:04:41 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:41 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-90f1c74c-7845-46a9-b0db-ccce25633750" returned: 0 in 0.712s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Lock "cinder-quobyte-90f1c74c-7845-46a9-b0db-ccce25633750" released by "delete_volume" :: held 2.463s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:04:41 devstack cinder-volume[86676]: WARNING cinder.quota [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 04 00:04:41 devstack cinder-volume[86676]: WARNING cinder.quota [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 04 00:04:41 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Created reservations ['e9dac8af-efba-417f-a91a-7645229b74ce', '95a443bb-cea9-46b7-b1f6-4ace061743dc', 'fc87c9d2-905f-48d9-9279-028964270017', '8d024a79-36af-43a5-a517-4b81f87968c4'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:04:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:04:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:41 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:04:41 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:42 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.690s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:42 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:04:42 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Deleted volume successfully. Jul 04 00:04:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-78c612eb-ed6c-47ee-9764-ff2abd22a1c4 tempest-VolumeAndVolumeTypeFromImageTest-1054837901 None] Lock "cinder-90f1c74c-7845-46a9-b0db-ccce25633750-delete_volume" released by "delete_volume" :: held 3.393s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Flow 'volume_create_manager' (eeb9900b-ed98-4f57-9606-4505447eda99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c1ef721-1de0-4a29-97bc-68e2950270aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c1ef721-1de0-4a29-97bc-68e2950270aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-194431441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddabd57310084839af9633364c184189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:48Z,use_quota=True,user_id='f7600c267aa84e9499efb5c3d925e040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb0a27e-a5f3-461d-a77c-f331d0fa112c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb0a27e-a5f3-461d-a77c-f331d0fa112c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72946eb-4cea-482a-a896-7ac063e75004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72946eb-4cea-482a-a896-7ac063e75004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f', 'volume_name': 'volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfa6fa2-a663-47bc-8847-ace8d20b3aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfa6fa2-a663-47bc-8847-ace8d20b3aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24eca11b-c3b0-496a-92c4-1391274dbcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:47 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Volume 5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f', 'volume_size': 1} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-194431441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddabd57310084839af9633364c184189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:48Z,use_quota=True,user_id='f7600c267aa84e9499efb5c3d925e040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Creating volume 5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:04:47 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:47 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f 1073741824 Jul 04 00:04:47 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:48 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f 1073741824" returned: 0 in 1.031s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:48 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f Jul 04 00:04:48 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:49 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f" returned: 0 in 0.769s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:04:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:04:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24eca11b-c3b0-496a-92c4-1391274dbcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b88db7-f920-42c6-844c-3f1ccf69708c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:49 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Volume volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f (5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f): created successfully Jul 04 00:04:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b88db7-f920-42c6-844c-3f1ccf69708c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Flow 'volume_create_manager' (eeb9900b-ed98-4f57-9606-4505447eda99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:04:49 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fbd4d0fe-0c7d-41a1-83af-6e7f35faef1a tempest-VolumeDependencyTests-1998054320 None] Created volume successfully. Jul 04 00:04:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-be66d154-b597-411a-8609-2f926bc6d0a0 tempest-VolumeDependencyTests-1998054320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:04:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-be66d154-b597-411a-8609-2f926bc6d0a0 tempest-VolumeDependencyTests-1998054320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:04:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-be66d154-b597-411a-8609-2f926bc6d0a0 tempest-VolumeDependencyTests-1998054320 None] Creating offline snapshot 43f4550b-bc93-438f-8160-cf95bb627bf5 of volume 5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:04:49 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2edf477-44bc-404e-897a-7e914368f156]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:04:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-be66d154-b597-411a-8609-2f926bc6d0a0 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:50 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f Jul 04 00:04:50 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:50 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-be66d154-b597-411a-8609-2f926bc6d0a0 tempest-VolumeDependencyTests-1998054320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f" returned: 0 in 0.835s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-be66d154-b597-411a-8609-2f926bc6d0a0 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:50 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5 1G Jul 04 00:04:50 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:51 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-be66d154-b597-411a-8609-2f926bc6d0a0 tempest-VolumeDependencyTests-1998054320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5 1G" returned: 0 in 0.856s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-be66d154-b597-411a-8609-2f926bc6d0a0 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:51 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5 Jul 04 00:04:51 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:52 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-be66d154-b597-411a-8609-2f926bc6d0a0 tempest-VolumeDependencyTests-1998054320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5" returned: 0 in 0.737s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:52 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-be66d154-b597-411a-8609-2f926bc6d0a0 tempest-VolumeDependencyTests-1998054320 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5 is being set with open permissions: ugo+rw Jul 04 00:04:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-be66d154-b597-411a-8609-2f926bc6d0a0 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:52 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5 Jul 04 00:04:52 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:53 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-be66d154-b597-411a-8609-2f926bc6d0a0 tempest-VolumeDependencyTests-1998054320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5" returned: 0 in 0.686s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-be66d154-b597-411a-8609-2f926bc6d0a0 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:53 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.info Jul 04 00:04:53 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:53 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-be66d154-b597-411a-8609-2f926bc6d0a0 tempest-VolumeDependencyTests-1998054320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.info" returned: 0 in 0.715s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:53 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-be66d154-b597-411a-8609-2f926bc6d0a0 tempest-VolumeDependencyTests-1998054320 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.info is being set with open permissions: ugo+rw Jul 04 00:04:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-be66d154-b597-411a-8609-2f926bc6d0a0 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:53 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.info Jul 04 00:04:53 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-47ab139d-00a8-4bd8-b654-e447775bb736 req-7a11ddd6-2118-40ea-845a-20d67c0f8e31 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:04:54 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-be66d154-b597-411a-8609-2f926bc6d0a0 tempest-VolumeDependencyTests-1998054320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.info" returned: 0 in 0.746s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-be66d154-b597-411a-8609-2f926bc6d0a0 tempest-VolumeDependencyTests-1998054320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.672s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:04:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-47ab139d-00a8-4bd8-b654-e447775bb736 req-7a11ddd6-2118-40ea-845a-20d67c0f8e31 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.409s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:04:54 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d2cbe7-702f-4f32-a478-71783a81be45]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:04:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-47ab139d-00a8-4bd8-b654-e447775bb736 req-7a11ddd6-2118-40ea-845a-20d67c0f8e31 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:54 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-be66d154-b597-411a-8609-2f926bc6d0a0 tempest-VolumeDependencyTests-1998054320 None] Create snapshot completed successfully Jul 04 00:04:54 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d Jul 04 00:04:54 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:55 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-47ab139d-00a8-4bd8-b654-e447775bb736 req-7a11ddd6-2118-40ea-845a-20d67c0f8e31 tempest-TestServerVolumeAttachmentScenario-1460773637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d" returned: 0 in 0.874s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-47ab139d-00a8-4bd8-b654-e447775bb736 req-7a11ddd6-2118-40ea-845a-20d67c0f8e31 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.898s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-47ab139d-00a8-4bd8-b654-e447775bb736 req-7a11ddd6-2118-40ea-845a-20d67c0f8e31 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e9f5a62-fc8c-4f90-97c5-7e288273fe7d', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 04 00:04:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-47ab139d-00a8-4bd8-b654-e447775bb736 req-7a11ddd6-2118-40ea-845a-20d67c0f8e31 tempest-TestServerVolumeAttachmentScenario-1460773637 None] attachment_update completed successfully. Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Flow 'volume_create_manager' (6381745c-8072-4cff-8a4f-91ab9f0ce963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbdde9bb-65ad-4d8d-95b1-a7ee42b8ff97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbdde9bb-65ad-4d8d-95b1-a7ee42b8ff97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-372096648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60742093-0ead-4409-affe-c25f4ffa97c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddabd57310084839af9633364c184189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=43f4550b-bc93-438f-8160-cf95bb627bf5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:56Z,use_quota=True,user_id='f7600c267aa84e9499efb5c3d925e040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8efc3c3-da8d-44ba-a412-bd76436e7fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8efc3c3-da8d-44ba-a412-bd76436e7fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c47439-5926-4c54-908c-676d3acb33b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c47439-5926-4c54-908c-676d3acb33b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '60742093-0ead-4409-affe-c25f4ffa97c0', 'volume_name': 'volume-60742093-0ead-4409-affe-c25f4ffa97c0', 'volume_size': 1, 'snapshot_id': '43f4550b-bc93-438f-8160-cf95bb627bf5'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed129f5d-040c-4aab-850c-d3ed26811742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed129f5d-040c-4aab-850c-d3ed26811742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e29399-caa3-4b80-b63b-0272ba01ceba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:04:55 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Volume 60742093-0ead-4409-affe-c25f4ffa97c0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-60742093-0ead-4409-affe-c25f4ffa97c0', 'volume_size': 1, 'snapshot_id': '43f4550b-bc93-438f-8160-cf95bb627bf5'} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Acquiring lock "cinder-quobyte-43f4550b-bc93-438f-8160-cf95bb627bf5-60742093-0ead-4409-affe-c25f4ffa97c0" by "_create_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Lock "cinder-quobyte-43f4550b-bc93-438f-8160-cf95bb627bf5-60742093-0ead-4409-affe-c25f4ffa97c0" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Creating volume 60742093-0ead-4409-affe-c25f4ffa97c0 from snapshot 43f4550b-bc93-438f-8160-cf95bb627bf5 {{(pid=86676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Acquiring lock "cinder-quobyte-60742093-0ead-4409-affe-c25f4ffa97c0" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Lock "cinder-quobyte-60742093-0ead-4409-affe-c25f4ffa97c0" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] snapshot: 43f4550b-bc93-438f-8160-cf95bb627bf5, volume: 60742093-0ead-4409-affe-c25f4ffa97c0, {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:04:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:04:56 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1100ab7-2c7f-4e0b-827a-c52c06b479b6]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:04:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:56 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5 Jul 04 00:04:56 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:57 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5" returned: 0 in 0.999s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:04:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 04 00:04:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 04 00:04:57 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7303480f-70c8-433e-834d-7fefeee29577]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:04:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:57 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f Jul 04 00:04:57 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:04:57 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Jul 04 00:04:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f" returned: 0 in 0.841s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:04:57 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Path /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-60742093-0ead-4409-affe-c25f4ffa97c0 not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 04 00:04:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-60742093-0ead-4409-affe-c25f4ffa97c0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:04:57 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-60742093-0ead-4409-affe-c25f4ffa97c0 Jul 04 00:04:57 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:03 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-60742093-0ead-4409-affe-c25f4ffa97c0" returned: 0 in 5.457s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc2a934-9d2a-4dcb-9e05-d66df13e20f1]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:05:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:03 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f Jul 04 00:05:03 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f" returned: 0 in 1.237s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:04 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f, size 1024.00 MB, duration 5.46 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-60742093-0ead-4409-affe-c25f4ffa97c0 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 04 00:05:04 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Converted 1024.00 MB image at 187.62 MB/s Jul 04 00:05:04 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-60742093-0ead-4409-affe-c25f4ffa97c0 is being set with open permissions: ugo+rw Jul 04 00:05:04 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-60742093-0ead-4409-affe-c25f4ffa97c0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:04 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-60742093-0ead-4409-affe-c25f4ffa97c0 Jul 04 00:05:04 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:05 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-60742093-0ead-4409-affe-c25f4ffa97c0" returned: 0 in 0.693s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Lock "cinder-quobyte-60742093-0ead-4409-affe-c25f4ffa97c0" released by "_copy_volume_from_snapshot" :: held 9.363s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:05:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Lock "cinder-quobyte-43f4550b-bc93-438f-8160-cf95bb627bf5-60742093-0ead-4409-affe-c25f4ffa97c0" released by "_create_volume_from_snapshot" :: held 9.411s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:05:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.435s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:05:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e29399-caa3-4b80-b63b-0272ba01ceba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60742093-0ead-4409-affe-c25f4ffa97c0', 'volume_size': 1, 'snapshot_id': '43f4550b-bc93-438f-8160-cf95bb627bf5'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:05:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b187ab-e448-4d53-afdc-2ceb4ef35253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:05:05 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Volume volume-60742093-0ead-4409-affe-c25f4ffa97c0 (60742093-0ead-4409-affe-c25f4ffa97c0): created successfully Jul 04 00:05:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b187ab-e448-4d53-afdc-2ceb4ef35253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:05:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Flow 'volume_create_manager' (6381745c-8072-4cff-8a4f-91ab9f0ce963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:05:05 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b07a795d-8ce8-4236-92a9-06d593823239 tempest-VolumeDependencyTests-1998054320 None] Created volume successfully. Jul 04 00:05:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] Acquiring lock "cinder-43f4550b-bc93-438f-8160-cf95bb627bf5-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:05:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] Lock "cinder-43f4550b-bc93-438f-8160-cf95bb627bf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:05:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] Acquiring lock "cinder-quobyte-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:05:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] Lock "cinder-quobyte-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:05:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] Acquiring lock "cinder-quobyte-43f4550b-bc93-438f-8160-cf95bb627bf5" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:05:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] Lock "cinder-quobyte-43f4550b-bc93-438f-8160-cf95bb627bf5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:05:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] Deleting offline snapshot 43f4550b-bc93-438f-8160-cf95bb627bf5 of volume 5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:05:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] snapshot_file for this snap is: volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:05:06 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[19de5074-6666-48ae-97a5-8f91fb334065]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:06 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5 Jul 04 00:05:06 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:06 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5" returned: 0 in 0.842s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:05:06 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55163a8-b3ee-4571-a258-d13c6990a0e4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:07 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f Jul 04 00:05:07 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:07 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f" returned: 0 in 0.971s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:07 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5 Jul 04 00:05:07 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-45039ac6-7a72-4ab3-958c-2056f50c5d37 req-e90c35c0-9b10-49fe-999e-6372f1880bda tempest-TestServerVolumeAttachmentScenario-1460773637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:05:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-45039ac6-7a72-4ab3-958c-2056f50c5d37 req-e90c35c0-9b10-49fe-999e-6372f1880bda tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:05:08 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[83080052-4312-4a45-bf34-1ba0c53f1c6f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:05:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-45039ac6-7a72-4ab3-958c-2056f50c5d37 req-e90c35c0-9b10-49fe-999e-6372f1880bda tempest-TestServerVolumeAttachmentScenario-1460773637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f0cca665-8338-46bc-ba0b-2c20146bae4a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:08 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f0cca665-8338-46bc-ba0b-2c20146bae4a Jul 04 00:05:08 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:08 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5" returned: 0 in 0.896s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:08 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5 Jul 04 00:05:08 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:08 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-45039ac6-7a72-4ab3-958c-2056f50c5d37 req-e90c35c0-9b10-49fe-999e-6372f1880bda tempest-TestServerVolumeAttachmentScenario-1460773637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f0cca665-8338-46bc-ba0b-2c20146bae4a" returned: 0 in 0.958s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-45039ac6-7a72-4ab3-958c-2056f50c5d37 req-e90c35c0-9b10-49fe-999e-6372f1880bda tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.978s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-45039ac6-7a72-4ab3-958c-2056f50c5d37 req-e90c35c0-9b10-49fe-999e-6372f1880bda tempest-TestServerVolumeAttachmentScenario-1460773637 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-f0cca665-8338-46bc-ba0b-2c20146bae4a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2be2e5e4-7357-42b8-bc87-a9b373052dbb', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 04 00:05:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-45039ac6-7a72-4ab3-958c-2056f50c5d37 req-e90c35c0-9b10-49fe-999e-6372f1880bda tempest-TestServerVolumeAttachmentScenario-1460773637 None] attachment_update completed successfully. Jul 04 00:05:09 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f.43f4550b-bc93-438f-8160-cf95bb627bf5" returned: 0 in 0.743s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] Lock "cinder-quobyte-43f4550b-bc93-438f-8160-cf95bb627bf5" released by "_delete_snapshot" :: held 3.587s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:05:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] Lock "cinder-quobyte-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f" released by "delete_snapshot" :: held 3.620s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:05:09 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] Created reservations ['35eddb0d-7391-4d4e-9520-91eac61b2358', 'ff04265e-bc58-4cdf-8fac-a6877df8bc68', '0dbb3884-5275-4d77-96d0-384e58fe4299', 'bfa51262-1022-479f-8412-4745c3d996e8'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:05:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] Delete snapshot completed successfully. Jul 04 00:05:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-abe5e1d5-b3fc-4ba4-8c71-4fc37d0930d3 tempest-VolumeDependencyTests-1998054320 None] Lock "cinder-43f4550b-bc93-438f-8160-cf95bb627bf5-delete_snapshot" released by "delete_snapshot" :: held 3.815s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:05:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] Acquiring lock "cinder-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:05:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] Lock "cinder-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:05:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] Acquiring lock "cinder-quobyte-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:05:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] Lock "cinder-quobyte-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:05:10 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ebb841-a257-4d2a-90fc-568f46e60024]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:05:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:10 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f Jul 04 00:05:10 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:11 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f" returned: 0 in 0.884s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:11 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f Jul 04 00:05:11 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:12 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f" returned: 0 in 0.736s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] Lock "cinder-quobyte-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f" released by "delete_volume" :: held 1.680s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:05:12 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] Created reservations ['cc9aad55-b06d-4d45-96b3-29fd257ef8ed', 'bb61ed21-d669-4096-810e-62ee5f945156', '8130cd45-badb-4871-b9e2-c9f36b0e0efc', 'a8bd3353-1ac2-4bc2-ba74-9e1aabbf389d'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:05:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:05:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:05:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:05:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:05:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:05:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:12 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:05:12 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] Acquiring lock "cinder-60742093-0ead-4409-affe-c25f4ffa97c0-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:05:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] Lock "cinder-60742093-0ead-4409-affe-c25f4ffa97c0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:05:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] Acquiring lock "cinder-quobyte-60742093-0ead-4409-affe-c25f4ffa97c0" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:05:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] Lock "cinder-quobyte-60742093-0ead-4409-affe-c25f4ffa97c0" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:05:12 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d505c43-1765-4365-9481-0424ea3655ba]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:05:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-60742093-0ead-4409-affe-c25f4ffa97c0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:13 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-60742093-0ead-4409-affe-c25f4ffa97c0 Jul 04 00:05:13 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:13 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.823s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:13 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:05:13 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] Deleted volume successfully. Jul 04 00:05:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f683fbbf-5a68-46ce-98b3-7590145532f5 tempest-VolumeDependencyTests-1998054320 None] Lock "cinder-5a22dbc4-cdee-496b-9d1e-1d9c3bfd145f-delete_volume" released by "delete_volume" :: held 2.762s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:05:13 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-60742093-0ead-4409-affe-c25f4ffa97c0" returned: 0 in 0.887s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-60742093-0ead-4409-affe-c25f4ffa97c0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:13 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-60742093-0ead-4409-affe-c25f4ffa97c0 Jul 04 00:05:13 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:14 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-60742093-0ead-4409-affe-c25f4ffa97c0" returned: 0 in 0.923s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] Lock "cinder-quobyte-60742093-0ead-4409-affe-c25f4ffa97c0" released by "delete_volume" :: held 1.894s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:05:14 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] Created reservations ['f103cc5e-760d-4dd7-ab5b-97e65d83b99d', 'd0a71f1b-1f13-4f04-b5b7-d90dc849d5ba', '3a6bc3b2-7b90-4c22-b70c-9a84b0577ced', '7f50c0ea-f6f9-4e46-bfcb-004c7bd259b1'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:05:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:05:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:05:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:05:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:05:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:05:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:14 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:05:14 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:15 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.077s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:15 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:05:15 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] Deleted volume successfully. Jul 04 00:05:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bd76020c-3011-4c08-bbfc-2b9a8a5987b8 tempest-VolumeDependencyTests-1998054320 None] Lock "cinder-60742093-0ead-4409-affe-c25f4ffa97c0-delete_volume" released by "delete_volume" :: held 3.310s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:05:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-05452d72-203c-45c8-b44d-825419031b7b req-7ee23fcb-626e-49dc-a843-4b12c5257a55 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Terminate volume connection completed successfully. Jul 04 00:05:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-05452d72-203c-45c8-b44d-825419031b7b req-7ee23fcb-626e-49dc-a843-4b12c5257a55 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Deleting attachment 2be2e5e4-7357-42b8-bc87-a9b373052dbb. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 04 00:05:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-0d644b79-f855-4335-a70c-36fe11c1d478 req-0f00f4ab-9edd-4107-be7a-646901c98c39 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Terminate volume connection completed successfully. Jul 04 00:05:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-0d644b79-f855-4335-a70c-36fe11c1d478 req-0f00f4ab-9edd-4107-be7a-646901c98c39 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Deleting attachment 1e9f5a62-fc8c-4f90-97c5-7e288273fe7d. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 04 00:05:30 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=52,cinder:INSERT=17,cinder:UPDATE=49,cinder:DELETE=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:05:30 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=51,cinder:SELECT=53,cinder:INSERT=14,cinder:DELETE=6 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:05:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:05:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:05:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:05:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:05:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:05:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:05:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:33 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:05:33 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Acquiring lock "cinder-f0cca665-8338-46bc-ba0b-2c20146bae4a-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:05:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "cinder-f0cca665-8338-46bc-ba0b-2c20146bae4a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:05:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Acquiring lock "cinder-quobyte-f0cca665-8338-46bc-ba0b-2c20146bae4a" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:05:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "cinder-quobyte-f0cca665-8338-46bc-ba0b-2c20146bae4a" acquired by "delete_volume" :: waited 0.035s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:05:33 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1a5767-5ff7-4e2d-8ef7-6988a045286e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:05:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f0cca665-8338-46bc-ba0b-2c20146bae4a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:33 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f0cca665-8338-46bc-ba0b-2c20146bae4a Jul 04 00:05:33 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:34 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.823s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:05:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:05:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:05:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:05:34 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f0cca665-8338-46bc-ba0b-2c20146bae4a" returned: 0 in 0.948s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f0cca665-8338-46bc-ba0b-2c20146bae4a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:34 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f0cca665-8338-46bc-ba0b-2c20146bae4a Jul 04 00:05:34 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:35 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f0cca665-8338-46bc-ba0b-2c20146bae4a" returned: 0 in 0.855s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "cinder-quobyte-f0cca665-8338-46bc-ba0b-2c20146bae4a" released by "delete_volume" :: held 1.870s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:05:35 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Created reservations ['c0e36461-46ae-42cb-b3bd-de3e389c47fe', 'd19afd4f-1844-4acb-9e28-95b001d684d7', 'e3914077-9a72-41c6-9574-b4eaa5d4a35d', 'bf688113-6beb-4a94-9ffa-70bea6247c40'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:05:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:05:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:05:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:05:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:05:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:05:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:36 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:05:36 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Acquiring lock "cinder-3e68484f-87a9-4b70-952c-72f4f9e33e5d-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:05:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "cinder-3e68484f-87a9-4b70-952c-72f4f9e33e5d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:05:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Acquiring lock "cinder-quobyte-3e68484f-87a9-4b70-952c-72f4f9e33e5d" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:05:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "cinder-quobyte-3e68484f-87a9-4b70-952c-72f4f9e33e5d" acquired by "delete_volume" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:05:36 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b40991-5086-4334-a029-10e7ef9e5834]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:05:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:36 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d Jul 04 00:05:36 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:36 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.879s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:36 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:05:36 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Deleted volume successfully. Jul 04 00:05:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bfba27ca-8690-4cb5-820a-bbc3d60e82f7 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "cinder-f0cca665-8338-46bc-ba0b-2c20146bae4a-delete_volume" released by "delete_volume" :: held 3.312s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:05:37 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d" returned: 0 in 1.235s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:37 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d Jul 04 00:05:37 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:38 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3e68484f-87a9-4b70-952c-72f4f9e33e5d" returned: 0 in 0.937s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "cinder-quobyte-3e68484f-87a9-4b70-952c-72f4f9e33e5d" released by "delete_volume" :: held 2.230s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:05:38 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Created reservations ['71130a10-0dfc-4c4d-872e-fcdfba1a41f8', 'ceb54e62-5306-4ae2-aa92-e459a3e3c2cd', '20c6633b-2575-4d64-bcfb-66875da3da9a', '21384ae9-4c3d-436b-be28-5794c2aed44b'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:05:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:05:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:05:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:05:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:05:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:05:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:38 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:05:38 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:39 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.870s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:39 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:05:39 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Deleted volume successfully. Jul 04 00:05:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-15723ee1-730a-4f7e-8709-ebcef3259be1 tempest-TestServerVolumeAttachmentScenario-1460773637 None] Lock "cinder-3e68484f-87a9-4b70-952c-72f4f9e33e5d-delete_volume" released by "delete_volume" :: held 3.441s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Flow 'volume_create_manager' (f38db75f-5374-4f0a-bef2-8c4b1549ba6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4247f6e-6101-4993-b92f-eb8890466e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4247f6e-6101-4993-b92f-eb8890466e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1393935327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d930f339-7180-47d1-b285-4fa5553fe989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbafe9fa0b654eaab32e4a5f455abb9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:05:44Z,use_quota=True,user_id='ae0021419622486585c1dca1654f3f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b60cc37-71f4-4306-9d08-f5a267d62c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b60cc37-71f4-4306-9d08-f5a267d62c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92344ef7-eee3-49bc-9351-49435698ecac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92344ef7-eee3-49bc-9351-49435698ecac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd930f339-7180-47d1-b285-4fa5553fe989', 'volume_name': 'volume-d930f339-7180-47d1-b285-4fa5553fe989', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88010bca-79eb-4660-9413-28219a4e0705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88010bca-79eb-4660-9413-28219a4e0705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a506d6d-4567-47c7-b665-5f65c78b24e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:05:44 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Volume d930f339-7180-47d1-b285-4fa5553fe989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d930f339-7180-47d1-b285-4fa5553fe989', 'volume_size': 1} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1393935327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d930f339-7180-47d1-b285-4fa5553fe989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbafe9fa0b654eaab32e4a5f455abb9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:05:44Z,use_quota=True,user_id='ae0021419622486585c1dca1654f3f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Creating volume d930f339-7180-47d1-b285-4fa5553fe989 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:05:44 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:05:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:44 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 1073741824 Jul 04 00:05:44 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:45 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 1073741824" returned: 0 in 1.525s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:46 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 Jul 04 00:05:46 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:46 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:05:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Flow 'volume_create_manager' (58dfbe87-56a0-4536-939c-170f36fd152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:05:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb19bf50-b08c-4255-baba-6dba23b8b426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:05:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb19bf50-b08c-4255-baba-6dba23b8b426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-40697024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d0d746-9427-4677-9066-48f6df330a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4be50a3ce76414bac506c3f99b0fd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:05:47Z,use_quota=True,user_id='706c9d5f180c46e69cecb04fa132227a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:05:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a53a04-7c39-46a0-95e6-176c2eb8339e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:05:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a53a04-7c39-46a0-95e6-176c2eb8339e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:05:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234a68ea-db9f-4e2f-adf3-86511ed31e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:05:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234a68ea-db9f-4e2f-adf3-86511ed31e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94d0d746-9427-4677-9066-48f6df330a98', 'volume_name': 'volume-94d0d746-9427-4677-9066-48f6df330a98', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:05:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd1dce6-5934-45bd-be5a-1487616d5d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:05:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd1dce6-5934-45bd-be5a-1487616d5d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:05:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4e4d0d-fce1-47c7-82f1-a08aa5b7f901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:05:46 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Volume 94d0d746-9427-4677-9066-48f6df330a98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94d0d746-9427-4677-9066-48f6df330a98', 'volume_size': 1} Jul 04 00:05:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:05:47 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989" returned: 0 in 1.063s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] <== create_volume: return (2659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:05:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.663s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:05:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.240s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:05:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-40697024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d0d746-9427-4677-9066-48f6df330a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4be50a3ce76414bac506c3f99b0fd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:05:47Z,use_quota=True,user_id='706c9d5f180c46e69cecb04fa132227a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:05:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Creating volume 94d0d746-9427-4677-9066-48f6df330a98 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:05:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:05:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:05:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:05:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:05:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:05:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:05:47 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:05:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-94d0d746-9427-4677-9066-48f6df330a98 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:47 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-94d0d746-9427-4677-9066-48f6df330a98 1073741824 Jul 04 00:05:47 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a506d6d-4567-47c7-b665-5f65c78b24e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d930f339-7180-47d1-b285-4fa5553fe989', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:05:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c009485f-3226-4276-a8b1-b295cbf9164e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:05:47 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Volume volume-d930f339-7180-47d1-b285-4fa5553fe989 (d930f339-7180-47d1-b285-4fa5553fe989): created successfully Jul 04 00:05:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c009485f-3226-4276-a8b1-b295cbf9164e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:05:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Flow 'volume_create_manager' (f38db75f-5374-4f0a-bef2-8c4b1549ba6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:05:47 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-16a48f25-5f0c-4bc5-9743-3bdd628532d6 tempest-SnapshotDependencyTests-1713468319 None] Created volume successfully. Jul 04 00:05:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-306bc2a0-7717-4074-85d3-1130fe7929cc tempest-SnapshotDependencyTests-1713468319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:05:48 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-94d0d746-9427-4677-9066-48f6df330a98 1073741824" returned: 0 in 1.180s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-94d0d746-9427-4677-9066-48f6df330a98 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:48 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-94d0d746-9427-4677-9066-48f6df330a98 Jul 04 00:05:48 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:49 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-94d0d746-9427-4677-9066-48f6df330a98" returned: 0 in 0.976s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] <== create_volume: return (2224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:05:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.229s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:05:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-306bc2a0-7717-4074-85d3-1130fe7929cc tempest-SnapshotDependencyTests-1713468319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.201s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:05:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4e4d0d-fce1-47c7-82f1-a08aa5b7f901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d0d746-9427-4677-9066-48f6df330a98', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:05:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae811761-c739-4a75-b6c0-c3bd52133361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:05:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-306bc2a0-7717-4074-85d3-1130fe7929cc tempest-SnapshotDependencyTests-1713468319 None] Creating offline snapshot 9e1a099e-aad8-4cec-9173-7a950c541ade of volume d930f339-7180-47d1-b285-4fa5553fe989 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:05:49 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Volume volume-94d0d746-9427-4677-9066-48f6df330a98 (94d0d746-9427-4677-9066-48f6df330a98): created successfully Jul 04 00:05:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae811761-c739-4a75-b6c0-c3bd52133361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:05:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Flow 'volume_create_manager' (58dfbe87-56a0-4536-939c-170f36fd152a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:05:49 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[310f240a-716c-4dd0-a323-ef3815b0e088]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:05:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-306bc2a0-7717-4074-85d3-1130fe7929cc tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:49 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9750e32d-907a-4b78-a92c-31cc7663fa53 tempest-TestMinimumBasicScenario-811166558 None] Created volume successfully. Jul 04 00:05:49 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 Jul 04 00:05:49 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:50 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-306bc2a0-7717-4074-85d3-1130fe7929cc tempest-SnapshotDependencyTests-1713468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989" returned: 0 in 1.096s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-306bc2a0-7717-4074-85d3-1130fe7929cc tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:50 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade 1G Jul 04 00:05:50 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:51 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-306bc2a0-7717-4074-85d3-1130fe7929cc tempest-SnapshotDependencyTests-1713468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade 1G" returned: 0 in 1.286s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-306bc2a0-7717-4074-85d3-1130fe7929cc tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d930f339-7180-47d1-b285-4fa5553fe989 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:51 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d930f339-7180-47d1-b285-4fa5553fe989 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade Jul 04 00:05:51 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:52 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-306bc2a0-7717-4074-85d3-1130fe7929cc tempest-SnapshotDependencyTests-1713468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d930f339-7180-47d1-b285-4fa5553fe989 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade" returned: 0 in 1.135s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:52 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-306bc2a0-7717-4074-85d3-1130fe7929cc tempest-SnapshotDependencyTests-1713468319 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade is being set with open permissions: ugo+rw Jul 04 00:05:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-306bc2a0-7717-4074-85d3-1130fe7929cc tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:52 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade Jul 04 00:05:52 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-8595a78b-e0ac-43f8-88bb-2d76679eb47c req-f9198875-f6bb-493b-8dcd-2c26b4f7aa94 tempest-TestMinimumBasicScenario-811166558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:05:53 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-306bc2a0-7717-4074-85d3-1130fe7929cc tempest-SnapshotDependencyTests-1713468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade" returned: 0 in 0.750s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-306bc2a0-7717-4074-85d3-1130fe7929cc tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:53 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.info Jul 04 00:05:53 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:54 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-306bc2a0-7717-4074-85d3-1130fe7929cc tempest-SnapshotDependencyTests-1713468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.info" returned: 0 in 0.775s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:54 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-306bc2a0-7717-4074-85d3-1130fe7929cc tempest-SnapshotDependencyTests-1713468319 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.info is being set with open permissions: ugo+rw Jul 04 00:05:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-306bc2a0-7717-4074-85d3-1130fe7929cc tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:54 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.info Jul 04 00:05:54 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:55 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-306bc2a0-7717-4074-85d3-1130fe7929cc tempest-SnapshotDependencyTests-1713468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.info" returned: 0 in 0.713s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-306bc2a0-7717-4074-85d3-1130fe7929cc tempest-SnapshotDependencyTests-1713468319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.898s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:05:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-8595a78b-e0ac-43f8-88bb-2d76679eb47c req-f9198875-f6bb-493b-8dcd-2c26b4f7aa94 tempest-TestMinimumBasicScenario-811166558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.866s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:05:55 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cb90e2-3cd7-44d5-a012-fca1cdfa9c33]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:05:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-8595a78b-e0ac-43f8-88bb-2d76679eb47c req-f9198875-f6bb-493b-8dcd-2c26b4f7aa94 tempest-TestMinimumBasicScenario-811166558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-94d0d746-9427-4677-9066-48f6df330a98 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-306bc2a0-7717-4074-85d3-1130fe7929cc tempest-SnapshotDependencyTests-1713468319 None] Create snapshot completed successfully Jul 04 00:05:55 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-94d0d746-9427-4677-9066-48f6df330a98 Jul 04 00:05:55 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:56 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-8595a78b-e0ac-43f8-88bb-2d76679eb47c req-f9198875-f6bb-493b-8dcd-2c26b4f7aa94 tempest-TestMinimumBasicScenario-811166558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-94d0d746-9427-4677-9066-48f6df330a98" returned: 0 in 0.939s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-8595a78b-e0ac-43f8-88bb-2d76679eb47c req-f9198875-f6bb-493b-8dcd-2c26b4f7aa94 tempest-TestMinimumBasicScenario-811166558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.962s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-8595a78b-e0ac-43f8-88bb-2d76679eb47c req-f9198875-f6bb-493b-8dcd-2c26b4f7aa94 tempest-TestMinimumBasicScenario-811166558 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-94d0d746-9427-4677-9066-48f6df330a98', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbc75ed0-786e-49db-be38-d81418173383', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Flow 'volume_create_manager' (6d959179-40f0-4eb2-b350-38f990f082ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70f00fa-b84f-4849-9b0c-8d43beeb34de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70f00fa-b84f-4849-9b0c-8d43beeb34de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ead03370-3632-421f-a2f6-453bfd0e8c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbafe9fa0b654eaab32e4a5f455abb9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9e1a099e-aad8-4cec-9173-7a950c541ade,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:05:56Z,use_quota=True,user_id='ae0021419622486585c1dca1654f3f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b5bee5-5b14-4133-810e-0e74d6f26a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b5bee5-5b14-4133-810e-0e74d6f26a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38b7ba7-2eca-4348-8f6f-ea5ff1680794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38b7ba7-2eca-4348-8f6f-ea5ff1680794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ead03370-3632-421f-a2f6-453bfd0e8c8b', 'volume_name': 'volume-ead03370-3632-421f-a2f6-453bfd0e8c8b', 'volume_size': 1, 'snapshot_id': '9e1a099e-aad8-4cec-9173-7a950c541ade'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fecdaa6-7cd0-4e2c-8dac-36d8642e180b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fecdaa6-7cd0-4e2c-8dac-36d8642e180b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e35bc37-dfdd-453e-b286-6dd42df3c89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:05:56 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Volume ead03370-3632-421f-a2f6-453bfd0e8c8b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ead03370-3632-421f-a2f6-453bfd0e8c8b', 'volume_size': 1, 'snapshot_id': '9e1a099e-aad8-4cec-9173-7a950c541ade'} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Acquiring lock "cinder-quobyte-9e1a099e-aad8-4cec-9173-7a950c541ade-ead03370-3632-421f-a2f6-453bfd0e8c8b" by "_create_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:05:56 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-8595a78b-e0ac-43f8-88bb-2d76679eb47c req-f9198875-f6bb-493b-8dcd-2c26b4f7aa94 tempest-TestMinimumBasicScenario-811166558 None] attachment_update completed successfully. Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Lock "cinder-quobyte-9e1a099e-aad8-4cec-9173-7a950c541ade-ead03370-3632-421f-a2f6-453bfd0e8c8b" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Creating volume ead03370-3632-421f-a2f6-453bfd0e8c8b from snapshot 9e1a099e-aad8-4cec-9173-7a950c541ade {{(pid=86676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Acquiring lock "cinder-quobyte-ead03370-3632-421f-a2f6-453bfd0e8c8b" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Lock "cinder-quobyte-ead03370-3632-421f-a2f6-453bfd0e8c8b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] snapshot: 9e1a099e-aad8-4cec-9173-7a950c541ade, volume: ead03370-3632-421f-a2f6-453bfd0e8c8b, {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b8bcdf-78d0-4640-b537-43906b7caeda]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:05:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:56 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade Jul 04 00:05:56 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:57 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade" returned: 0 in 0.912s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d930f339-7180-47d1-b285-4fa5553fe989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:05:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 04 00:05:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 04 00:05:57 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4b4bd7-ad8d-49f4-b3c1-e6ef2c29f9a4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:05:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:57 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 Jul 04 00:05:57 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:05:58 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Jul 04 00:05:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989" returned: 0 in 0.823s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:05:58 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Path /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ead03370-3632-421f-a2f6-453bfd0e8c8b not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 04 00:05:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ead03370-3632-421f-a2f6-453bfd0e8c8b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:05:58 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ead03370-3632-421f-a2f6-453bfd0e8c8b Jul 04 00:05:58 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:04 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ead03370-3632-421f-a2f6-453bfd0e8c8b" returned: 0 in 6.641s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:04 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd20372-a59e-42f3-bb18-b84cd76f4a1a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:06:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:05 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 Jul 04 00:06:05 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:06 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989" returned: 0 in 1.276s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:06 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ead03370-3632-421f-a2f6-453bfd0e8c8b {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 04 00:06:06 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Converted 1024.00 MB image at 154.14 MB/s Jul 04 00:06:06 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ead03370-3632-421f-a2f6-453bfd0e8c8b is being set with open permissions: ugo+rw Jul 04 00:06:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ead03370-3632-421f-a2f6-453bfd0e8c8b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:06 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ead03370-3632-421f-a2f6-453bfd0e8c8b Jul 04 00:06:06 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:06 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=21,cinder:SELECT=25,cinder:INSERT=5,cinder:DELETE=4 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:06:06 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=25,cinder:INSERT=6,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:06:07 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ead03370-3632-421f-a2f6-453bfd0e8c8b" returned: 0 in 0.821s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Lock "cinder-quobyte-ead03370-3632-421f-a2f6-453bfd0e8c8b" released by "_copy_volume_from_snapshot" :: held 10.588s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:06:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Lock "cinder-quobyte-9e1a099e-aad8-4cec-9173-7a950c541ade-ead03370-3632-421f-a2f6-453bfd0e8c8b" released by "_create_volume_from_snapshot" :: held 10.624s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:06:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.648s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:06:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e35bc37-dfdd-453e-b286-6dd42df3c89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ead03370-3632-421f-a2f6-453bfd0e8c8b', 'volume_size': 1, 'snapshot_id': '9e1a099e-aad8-4cec-9173-7a950c541ade'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:06:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75594970-a853-43d7-9daf-450a779ccbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:06:07 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Volume volume-ead03370-3632-421f-a2f6-453bfd0e8c8b (ead03370-3632-421f-a2f6-453bfd0e8c8b): created successfully Jul 04 00:06:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75594970-a853-43d7-9daf-450a779ccbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:06:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Flow 'volume_create_manager' (6d959179-40f0-4eb2-b350-38f990f082ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:06:07 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-88f8bcd0-9652-4912-91b8-92c542a0d690 tempest-SnapshotDependencyTests-1713468319 None] Created volume successfully. Jul 04 00:06:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] Acquiring lock "cinder-9e1a099e-aad8-4cec-9173-7a950c541ade-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:06:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] Lock "cinder-9e1a099e-aad8-4cec-9173-7a950c541ade-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:06:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] Acquiring lock "cinder-quobyte-d930f339-7180-47d1-b285-4fa5553fe989" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:06:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] Lock "cinder-quobyte-d930f339-7180-47d1-b285-4fa5553fe989" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:06:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] Acquiring lock "cinder-quobyte-9e1a099e-aad8-4cec-9173-7a950c541ade" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:06:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] Lock "cinder-quobyte-9e1a099e-aad8-4cec-9173-7a950c541ade" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:06:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] Deleting offline snapshot 9e1a099e-aad8-4cec-9173-7a950c541ade of volume d930f339-7180-47d1-b285-4fa5553fe989 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:06:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] snapshot_file for this snap is: volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:06:08 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baf76ad-e9ca-4ac9-b0ec-3d9f82717798]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:06:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:08 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade Jul 04 00:06:08 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:09 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade" returned: 0 in 0.974s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d930f339-7180-47d1-b285-4fa5553fe989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:06:09 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[922190f3-4180-4c25-8ed0-1abf34a9a127]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:06:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:09 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 Jul 04 00:06:09 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:10 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989" returned: 0 in 1.066s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:10 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade Jul 04 00:06:10 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:11 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade" returned: 0 in 1.043s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:11 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade Jul 04 00:06:11 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:12 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989.9e1a099e-aad8-4cec-9173-7a950c541ade" returned: 0 in 0.981s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] Lock "cinder-quobyte-9e1a099e-aad8-4cec-9173-7a950c541ade" released by "_delete_snapshot" :: held 4.214s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:06:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] Lock "cinder-quobyte-d930f339-7180-47d1-b285-4fa5553fe989" released by "delete_snapshot" :: held 4.246s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:06:12 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] Created reservations ['4a324d13-2226-4a4b-8c42-20a50b9b017f', '71e8d82f-8e63-4a8c-abea-d6b77d0ddebf', 'd90c1019-ae9d-447f-bc65-bafa192631e2', '5f46d7b9-2bfb-4a79-a6fd-fbce1c2c5729'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:06:12 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] Delete snapshot completed successfully. Jul 04 00:06:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a1a6596c-50d5-4e11-ae52-12ece992d071 tempest-SnapshotDependencyTests-1713468319 None] Lock "cinder-9e1a099e-aad8-4cec-9173-7a950c541ade-delete_snapshot" released by "delete_snapshot" :: held 4.468s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:06:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] Acquiring lock "cinder-d930f339-7180-47d1-b285-4fa5553fe989-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:06:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] Lock "cinder-d930f339-7180-47d1-b285-4fa5553fe989-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:06:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] Acquiring lock "cinder-quobyte-d930f339-7180-47d1-b285-4fa5553fe989" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:06:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] Lock "cinder-quobyte-d930f339-7180-47d1-b285-4fa5553fe989" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:06:13 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa8ee5d-f374-4dfb-a4d9-fdf304cfe19a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:06:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:13 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 Jul 04 00:06:13 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:14 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989" returned: 0 in 0.858s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:14 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989 Jul 04 00:06:14 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:14 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d930f339-7180-47d1-b285-4fa5553fe989" returned: 0 in 0.657s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] Lock "cinder-quobyte-d930f339-7180-47d1-b285-4fa5553fe989" released by "delete_volume" :: held 1.583s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:06:15 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] Created reservations ['aee44ba0-2092-4b8c-a711-b02c1dcb6c1a', 'dcd271d5-6837-47c9-a571-b8103b98addd', '98cf9c66-a373-46f9-8e18-50e4d2bbf31d', 'a71963d8-f24a-4fab-84ab-7776123530eb'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:06:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:06:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:06:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:06:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:06:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:06:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:15 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:06:15 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] Acquiring lock "cinder-ead03370-3632-421f-a2f6-453bfd0e8c8b-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:06:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] Lock "cinder-ead03370-3632-421f-a2f6-453bfd0e8c8b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:06:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] Acquiring lock "cinder-quobyte-ead03370-3632-421f-a2f6-453bfd0e8c8b" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:06:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] Lock "cinder-quobyte-ead03370-3632-421f-a2f6-453bfd0e8c8b" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:06:15 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[298da537-dad6-4354-a40d-bff76982e139]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:06:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ead03370-3632-421f-a2f6-453bfd0e8c8b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:15 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ead03370-3632-421f-a2f6-453bfd0e8c8b Jul 04 00:06:15 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:15 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.788s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:15 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:06:15 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] Deleted volume successfully. Jul 04 00:06:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61c2de6a-bd05-4825-b429-75a3fed1c8d1 tempest-SnapshotDependencyTests-1713468319 None] Lock "cinder-d930f339-7180-47d1-b285-4fa5553fe989-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:06:16 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ead03370-3632-421f-a2f6-453bfd0e8c8b" returned: 0 in 0.910s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ead03370-3632-421f-a2f6-453bfd0e8c8b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:16 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ead03370-3632-421f-a2f6-453bfd0e8c8b Jul 04 00:06:16 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:17 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ead03370-3632-421f-a2f6-453bfd0e8c8b" returned: 0 in 0.767s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] Lock "cinder-quobyte-ead03370-3632-421f-a2f6-453bfd0e8c8b" released by "delete_volume" :: held 1.736s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:06:17 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] Created reservations ['4b003f33-42e6-4d6b-867d-ae15ee931c02', '8ba152e6-8a49-4415-8fa5-02be43bb3bfb', '94ded49e-a675-4969-bc4f-17e4d9dbfa02', '4af4a517-c441-4d8d-a65a-a45fbd837785'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:06:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:06:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:06:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:06:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:06:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:06:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:17 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:06:17 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:18 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.823s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:18 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:06:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] Deleted volume successfully. Jul 04 00:06:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-daaf1d3f-d2b9-462a-b2b2-a10856304dec tempest-SnapshotDependencyTests-1713468319 None] Lock "cinder-ead03370-3632-421f-a2f6-453bfd0e8c8b-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:06:25 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:06:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Flow 'volume_create_manager' (2c1fa6f4-1659-4153-a294-87c1b1b3a136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:06:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c574483c-b2ef-4a60-bcfd-c23b4500102d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:06:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c574483c-b2ef-4a60-bcfd-c23b4500102d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-599731449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51692d98-f01e-4a3f-a685-030f6cde638f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f36da3f6b18546d89db4fe68cd582d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:06:26Z,use_quota=True,user_id='b80c0c9e38344927ba19e349cebd12fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:06:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8c3a3b-6623-44f5-942b-948bacb9289a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:06:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8c3a3b-6623-44f5-942b-948bacb9289a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:06:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a50100b-4c8d-44dd-b641-b94f3a1a47be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:06:25 devstack cinder-volume[86676]: DEBUG cinder.image.glance [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Creating Keystone auth plugin from conf {{(pid=86676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 04 00:06:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a50100b-4c8d-44dd-b641-b94f3a1a47be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '51692d98-f01e-4a3f-a685-030f6cde638f', 'volume_name': 'volume-51692d98-f01e-4a3f-a685-030f6cde638f', 'volume_size': 1, 'image_id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47a94a0f3bea4708b842e25ca5b22b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:06:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23561b1e-a215-45b6-aef2-c2fa487e5642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:06:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23561b1e-a215-45b6-aef2-c2fa487e5642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:06:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1669f380-ef67-46ae-b9be-92b44d9da196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:06:26 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Volume 51692d98-f01e-4a3f-a685-030f6cde638f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-51692d98-f01e-4a3f-a685-030f6cde638f', 'volume_size': 1, 'image_id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47a94a0f3bea4708b842e25ca5b22b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 04 00:06:26 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Trying to clone 51692d98-f01e-4a3f-a685-030f6cde638f from image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}]). {{(pid=86676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 04 00:06:26 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1n8z5vgbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 04 00:06:26 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Image download 20.69 MB at 20.69 MB/s Jul 04 00:06:26 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[14938a22-aa99-44f5-b0c1-38384f179e99]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:06:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1n8z5vgbdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:27 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1n8z5vgbdevstack@QuobyteHD Jul 04 00:06:27 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:27 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1n8z5vgbdevstack@QuobyteHD" returned: 0 in 0.775s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:27 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Temporary image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 is fetched for user b80c0c9e38344927ba19e349cebd12fa. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 04 00:06:27 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0bacf3-5a58-4f72-9b36-d3f2ef5bd3b8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:06:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1n8z5vgbdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:27 devstack sudo[101288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1n8z5vgbdevstack@QuobyteHD Jul 04 00:06:27 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:28 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1n8z5vgbdevstack@QuobyteHD" returned: 0 in 0.874s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:06:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:06:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-599731449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51692d98-f01e-4a3f-a685-030f6cde638f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f36da3f6b18546d89db4fe68cd582d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:06:26Z,use_quota=True,user_id='b80c0c9e38344927ba19e349cebd12fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:06:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Creating volume 51692d98-f01e-4a3f-a685-030f6cde638f {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:06:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:06:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:06:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:06:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:06:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:06:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:06:28 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:06:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:28 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f 1073741824 Jul 04 00:06:28 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:29 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f 1073741824" returned: 0 in 1.186s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:29 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f Jul 04 00:06:29 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:30 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f" returned: 0 in 0.907s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] <== create_volume: return (2174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:06:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.177s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:06:30 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Attempting download of 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 ((None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}])) to volume 51692d98-f01e-4a3f-a685-030f6cde638f. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 04 00:06:30 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebf7b0d-33d6-442f-8288-4f4abdcf6f00]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:06:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_7q6yr8ns {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:31 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_7q6yr8ns Jul 04 00:06:31 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:31 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_7q6yr8ns" returned: 0 in 0.936s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_7q6yr8ns {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:31 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_7q6yr8ns Jul 04 00:06:31 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:32 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_7q6yr8ns" returned: 1 in 0.867s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_7q6yr8ns' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:06:32 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[52586c0f-aaea-4fe9-ae53-4c4293faf7a6]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:06:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1n8z5vgbdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:32 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1n8z5vgbdevstack@QuobyteHD Jul 04 00:06:32 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:06:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:06:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:06:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:06:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:06:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:06:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:33 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:06:33 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:33 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1n8z5vgbdevstack@QuobyteHD" returned: 0 in 0.967s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:33 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 was qcow2, converting to raw {{(pid=86676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 04 00:06:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1n8z5vgbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:33 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1n8z5vgbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f Jul 04 00:06:33 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:34 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.920s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:06:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:06:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:06:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:06:35 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1n8z5vgbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f" returned: 0 in 2.288s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:35 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_59c76a5b-22c5-4cc6-be6c-f55840e8aba7_1n8z5vgbdevstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 04 00:06:35 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Converted 112.00 MB image at 48.89 MB/s Jul 04 00:06:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:36 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f 1G Jul 04 00:06:36 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:36 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f 1G" returned: 0 in 0.686s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:36 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee790ff-c177-40e6-8f65-ea5f5553d314]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:06:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:36 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f Jul 04 00:06:36 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:37 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f" returned: 0 in 0.767s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:37 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f Jul 04 00:06:37 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:38 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f" returned: 1 in 0.778s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:06:38 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Downloaded image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 ((None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}])) to volume 51692d98-f01e-4a3f-a685-030f6cde638f successfully. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 04 00:06:38 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Temporary image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 for user b80c0c9e38344927ba19e349cebd12fa is deleted. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 04 00:06:38 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Marking volume 51692d98-f01e-4a3f-a685-030f6cde638f as bootable. {{(pid=86676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 04 00:06:38 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Copying metadata from image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 to 51692d98-f01e-4a3f-a685-030f6cde638f. {{(pid=86676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 04 00:06:38 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Creating volume glance metadata for volume 51692d98-f01e-4a3f-a685-030f6cde638f backed by image 59c76a5b-22c5-4cc6-be6c-f55840e8aba7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 04 00:06:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1669f380-ef67-46ae-b9be-92b44d9da196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51692d98-f01e-4a3f-a685-030f6cde638f', 'volume_size': 1, 'image_id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47a94a0f3bea4708b842e25ca5b22b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '59c76a5b-22c5-4cc6-be6c-f55840e8aba7', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59c76a5b-22c5-4cc6-be6c-f55840e8aba7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:06:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc1e5dc-9311-44bd-b32a-d6c6ebdd95e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:06:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Volume volume-51692d98-f01e-4a3f-a685-030f6cde638f (51692d98-f01e-4a3f-a685-030f6cde638f): created successfully Jul 04 00:06:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc1e5dc-9311-44bd-b32a-d6c6ebdd95e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:06:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Flow 'volume_create_manager' (2c1fa6f4-1659-4153-a294-87c1b1b3a136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:06:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4d8cf0d9-1850-4b2f-8fb2-c5f0b1840b7f tempest-TestShelveInstance-1606346922 None] Created volume successfully. Jul 04 00:06:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-83dc8c0c-845d-4c86-b9ed-7e48bda80d69 req-9f197add-4e4e-44e0-a03a-b8e49b647327 tempest-TestShelveInstance-1606346922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:06:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-83dc8c0c-845d-4c86-b9ed-7e48bda80d69 req-9f197add-4e4e-44e0-a03a-b8e49b647327 tempest-TestShelveInstance-1606346922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:06:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc16bbd6-6d30-4bdd-ad9f-4eafbaae9c72]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:06:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-83dc8c0c-845d-4c86-b9ed-7e48bda80d69 req-9f197add-4e4e-44e0-a03a-b8e49b647327 tempest-TestShelveInstance-1606346922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:46 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f Jul 04 00:06:46 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:47 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-83dc8c0c-845d-4c86-b9ed-7e48bda80d69 req-9f197add-4e4e-44e0-a03a-b8e49b647327 tempest-TestShelveInstance-1606346922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f" returned: 0 in 0.813s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-83dc8c0c-845d-4c86-b9ed-7e48bda80d69 req-9f197add-4e4e-44e0-a03a-b8e49b647327 tempest-TestShelveInstance-1606346922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:47 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f Jul 04 00:06:47 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:47 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-83dc8c0c-845d-4c86-b9ed-7e48bda80d69 req-9f197add-4e4e-44e0-a03a-b8e49b647327 tempest-TestShelveInstance-1606346922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f" returned: 1 in 0.777s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-83dc8c0c-845d-4c86-b9ed-7e48bda80d69 req-9f197add-4e4e-44e0-a03a-b8e49b647327 tempest-TestShelveInstance-1606346922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:06:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-83dc8c0c-845d-4c86-b9ed-7e48bda80d69 req-9f197add-4e4e-44e0-a03a-b8e49b647327 tempest-TestShelveInstance-1606346922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.637s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:06:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-83dc8c0c-845d-4c86-b9ed-7e48bda80d69 req-9f197add-4e4e-44e0-a03a-b8e49b647327 tempest-TestShelveInstance-1606346922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-51692d98-f01e-4a3f-a685-030f6cde638f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b82f92b4-1b2a-4d89-be34-7733c23e7276', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 04 00:06:47 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-83dc8c0c-845d-4c86-b9ed-7e48bda80d69 req-9f197add-4e4e-44e0-a03a-b8e49b647327 tempest-TestShelveInstance-1606346922 None] attachment_update completed successfully. Jul 04 00:06:56 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-bfa1f3cc-5df4-4d4f-81bc-f46fd8c5afc9 req-b8e4e30b-3ca9-4e70-89cd-d5bfd4b7a3bc tempest-TestMinimumBasicScenario-811166558 None] Terminate volume connection completed successfully. Jul 04 00:06:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-bfa1f3cc-5df4-4d4f-81bc-f46fd8c5afc9 req-b8e4e30b-3ca9-4e70-89cd-d5bfd4b7a3bc tempest-TestMinimumBasicScenario-811166558 None] Deleting attachment cbc75ed0-786e-49db-be38-d81418173383. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 04 00:06:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] Acquiring lock "cinder-94d0d746-9427-4677-9066-48f6df330a98-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:06:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] Lock "cinder-94d0d746-9427-4677-9066-48f6df330a98-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:06:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] Acquiring lock "cinder-quobyte-94d0d746-9427-4677-9066-48f6df330a98" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:06:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] Lock "cinder-quobyte-94d0d746-9427-4677-9066-48f6df330a98" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:06:58 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a8a2d1-c809-4b8e-a90f-efe1c2948a73]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:06:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-94d0d746-9427-4677-9066-48f6df330a98 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:58 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-94d0d746-9427-4677-9066-48f6df330a98 Jul 04 00:06:58 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:59 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-94d0d746-9427-4677-9066-48f6df330a98" returned: 0 in 0.809s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-94d0d746-9427-4677-9066-48f6df330a98 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:59 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-94d0d746-9427-4677-9066-48f6df330a98 Jul 04 00:06:59 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:06:59 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Jul 04 00:06:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-94d0d746-9427-4677-9066-48f6df330a98" returned: 0 in 0.677s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:06:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] Lock "cinder-quobyte-94d0d746-9427-4677-9066-48f6df330a98" released by "delete_volume" :: held 1.528s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:06:59 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] Created reservations ['508c36a0-05a6-43f3-848f-5e41ccfd77fe', '2efd4396-81a6-441a-ac8c-8909df70a3f5', '96c2b9dc-245f-496b-9bc6-8fa11da094e0', 'c564e487-f62c-4924-af8f-14fad4e92fbc'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:06:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:06:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:06:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:06:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:06:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:06:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:06:59 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:06:59 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:00 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.696s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:00 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:07:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] Deleted volume successfully. Jul 04 00:07:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f7c40e71-33a2-4a10-bf01-805bc148f2b3 tempest-TestMinimumBasicScenario-811166558 None] Lock "cinder-94d0d746-9427-4677-9066-48f6df330a98-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:07:11 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=30,cinder:DELETE=3,cinder:SELECT=38,cinder:INSERT=16 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:07:11 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=37,cinder:UPDATE=45,cinder:INSERT=14,cinder:DELETE=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:07:24 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-a37ec90e-1d07-420b-b583-dd3e67d91104 req-b0f1c77b-7a9e-4cfc-90cc-50228da9d3ad tempest-TestShelveInstance-1606346922 None] Terminate volume connection completed successfully. Jul 04 00:07:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-a37ec90e-1d07-420b-b583-dd3e67d91104 req-b0f1c77b-7a9e-4cfc-90cc-50228da9d3ad tempest-TestShelveInstance-1606346922 None] Deleting attachment b82f92b4-1b2a-4d89-be34-7733c23e7276. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 04 00:07:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-97966f96-a357-4219-a01a-70f605ff24e2 req-eab70437-ac23-4921-80f0-802e2586b03f tempest-TestShelveInstance-1606346922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:07:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-97966f96-a357-4219-a01a-70f605ff24e2 req-eab70437-ac23-4921-80f0-802e2586b03f tempest-TestShelveInstance-1606346922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:07:29 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6dfcc3-6040-40b9-8aa0-3836227f4035]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:07:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-97966f96-a357-4219-a01a-70f605ff24e2 req-eab70437-ac23-4921-80f0-802e2586b03f tempest-TestShelveInstance-1606346922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:29 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f Jul 04 00:07:29 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:29 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:07:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Flow 'volume_create_manager' (9907d1eb-e58f-4811-97e9-2527d872b3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:07:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7b9fa2-3c90-4cdd-a608-5de5fe966ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7b9fa2-3c90-4cdd-a608-5de5fe966ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1394718644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6280f560-4ad0-4134-88ba-787aaf1126d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553a23ff48b4a5b8b0fa874776b8a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:30Z,use_quota=True,user_id='43f6840351db4953aa9ce655c9bfb187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd21647-a38e-465e-95e3-46e85c43bc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd21647-a38e-465e-95e3-46e85c43bc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d7113ed-0d4f-49ee-838c-dd3eb7596386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d7113ed-0d4f-49ee-838c-dd3eb7596386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6280f560-4ad0-4134-88ba-787aaf1126d4', 'volume_name': 'volume-6280f560-4ad0-4134-88ba-787aaf1126d4', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92cf338e-eb60-40b2-9830-b95d7969254e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92cf338e-eb60-40b2-9830-b95d7969254e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be4236c-73f8-49c2-9637-c6fa899b5667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:29 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Volume 6280f560-4ad0-4134-88ba-787aaf1126d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6280f560-4ad0-4134-88ba-787aaf1126d4', 'volume_size': 1} Jul 04 00:07:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:07:30 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-97966f96-a357-4219-a01a-70f605ff24e2 req-eab70437-ac23-4921-80f0-802e2586b03f tempest-TestShelveInstance-1606346922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f" returned: 0 in 0.784s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-97966f96-a357-4219-a01a-70f605ff24e2 req-eab70437-ac23-4921-80f0-802e2586b03f tempest-TestShelveInstance-1606346922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:30 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f Jul 04 00:07:30 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:30 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-97966f96-a357-4219-a01a-70f605ff24e2 req-eab70437-ac23-4921-80f0-802e2586b03f tempest-TestShelveInstance-1606346922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f" returned: 1 in 0.718s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-97966f96-a357-4219-a01a-70f605ff24e2 req-eab70437-ac23-4921-80f0-802e2586b03f tempest-TestShelveInstance-1606346922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:07:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-97966f96-a357-4219-a01a-70f605ff24e2 req-eab70437-ac23-4921-80f0-802e2586b03f tempest-TestShelveInstance-1606346922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.557s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:07:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.088s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:07:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1394718644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6280f560-4ad0-4134-88ba-787aaf1126d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553a23ff48b4a5b8b0fa874776b8a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:30Z,use_quota=True,user_id='43f6840351db4953aa9ce655c9bfb187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:07:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Creating volume 6280f560-4ad0-4134-88ba-787aaf1126d4 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:07:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:07:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:07:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:07:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:07:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:07:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:07:30 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:07:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6280f560-4ad0-4134-88ba-787aaf1126d4 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:30 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6280f560-4ad0-4134-88ba-787aaf1126d4 1073741824 Jul 04 00:07:30 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-97966f96-a357-4219-a01a-70f605ff24e2 req-eab70437-ac23-4921-80f0-802e2586b03f tempest-TestShelveInstance-1606346922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-51692d98-f01e-4a3f-a685-030f6cde638f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4a2ae0c-9cd0-4866-b86c-892c4a597c5e', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 04 00:07:31 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-97966f96-a357-4219-a01a-70f605ff24e2 req-eab70437-ac23-4921-80f0-802e2586b03f tempest-TestShelveInstance-1606346922 None] attachment_update completed successfully. Jul 04 00:07:31 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6280f560-4ad0-4134-88ba-787aaf1126d4 1073741824" returned: 0 in 0.829s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6280f560-4ad0-4134-88ba-787aaf1126d4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:31 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6280f560-4ad0-4134-88ba-787aaf1126d4 Jul 04 00:07:31 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:32 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6280f560-4ad0-4134-88ba-787aaf1126d4" returned: 0 in 0.633s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:07:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:07:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be4236c-73f8-49c2-9637-c6fa899b5667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6280f560-4ad0-4134-88ba-787aaf1126d4', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120864f1-7e22-4364-8bc1-5e9b85f4c3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:32 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Volume volume-6280f560-4ad0-4134-88ba-787aaf1126d4 (6280f560-4ad0-4134-88ba-787aaf1126d4): created successfully Jul 04 00:07:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120864f1-7e22-4364-8bc1-5e9b85f4c3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Flow 'volume_create_manager' (9907d1eb-e58f-4811-97e9-2527d872b3dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:07:32 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b073aaea-bd6f-4fe9-8d8d-16971bd748e8 tempest-ProjectReaderTests-135048488 None] Created volume successfully. Jul 04 00:07:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] Acquiring lock "cinder-6280f560-4ad0-4134-88ba-787aaf1126d4-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:07:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] Lock "cinder-6280f560-4ad0-4134-88ba-787aaf1126d4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:07:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] Acquiring lock "cinder-quobyte-6280f560-4ad0-4134-88ba-787aaf1126d4" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:07:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] Lock "cinder-quobyte-6280f560-4ad0-4134-88ba-787aaf1126d4" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:07:33 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3c3d89-3c9b-455a-8c45-2ab329097267]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:07:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6280f560-4ad0-4134-88ba-787aaf1126d4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:33 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6280f560-4ad0-4134-88ba-787aaf1126d4 Jul 04 00:07:33 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:07:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:07:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:07:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:07:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:07:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:07:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:33 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:07:33 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:34 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6280f560-4ad0-4134-88ba-787aaf1126d4" returned: 0 in 0.861s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6280f560-4ad0-4134-88ba-787aaf1126d4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:34 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6280f560-4ad0-4134-88ba-787aaf1126d4 Jul 04 00:07:34 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:34 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.703s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:07:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:07:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:07:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:07:34 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-6280f560-4ad0-4134-88ba-787aaf1126d4" returned: 0 in 0.676s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] Lock "cinder-quobyte-6280f560-4ad0-4134-88ba-787aaf1126d4" released by "delete_volume" :: held 1.578s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:07:34 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] Created reservations ['469e6463-0db3-4da0-a27c-5b17144b3d3a', '5661960f-f8ab-425c-ac66-9a59b60a0bae', '8322b22f-4b47-40be-9494-aeddfd4c28ea', 'ac673eb0-593e-4046-8de6-9ab70e37c7df'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:07:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:07:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:07:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:07:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:07:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:07:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:34 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:07:34 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:35 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.691s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:07:35 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] Deleted volume successfully. Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5bc68bf-357c-41b8-9ae7-e1c661db3873 tempest-ProjectReaderTests-135048488 None] Lock "cinder-6280f560-4ad0-4134-88ba-787aaf1126d4-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Flow 'volume_create_manager' (e3160209-b57e-4462-aa8e-6436a93f4484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74a941d-9cec-448f-9c1b-f0e25b87745f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74a941d-9cec-448f-9c1b-f0e25b87745f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-345569098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372b400d-bbf8-4c3d-8708-e8348bc864f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553a23ff48b4a5b8b0fa874776b8a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:36Z,use_quota=True,user_id='43f6840351db4953aa9ce655c9bfb187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90027bdc-c204-43c9-bd9c-0ea0a4f495a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90027bdc-c204-43c9-bd9c-0ea0a4f495a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df75567-50f9-4ab9-814b-35d0daccb81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df75567-50f9-4ab9-814b-35d0daccb81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '372b400d-bbf8-4c3d-8708-e8348bc864f0', 'volume_name': 'volume-372b400d-bbf8-4c3d-8708-e8348bc864f0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b48e97-8ce1-4817-8481-dbd1a4a428cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b48e97-8ce1-4817-8481-dbd1a4a428cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8121b9c4-1f61-4c71-8034-1feea7bb6b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:35 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Volume 372b400d-bbf8-4c3d-8708-e8348bc864f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-372b400d-bbf8-4c3d-8708-e8348bc864f0', 'volume_size': 1} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-345569098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372b400d-bbf8-4c3d-8708-e8348bc864f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553a23ff48b4a5b8b0fa874776b8a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:36Z,use_quota=True,user_id='43f6840351db4953aa9ce655c9bfb187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Creating volume 372b400d-bbf8-4c3d-8708-e8348bc864f0 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:07:35 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:07:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-372b400d-bbf8-4c3d-8708-e8348bc864f0 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:35 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-372b400d-bbf8-4c3d-8708-e8348bc864f0 1073741824 Jul 04 00:07:35 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:36 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-372b400d-bbf8-4c3d-8708-e8348bc864f0 1073741824" returned: 0 in 1.040s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-372b400d-bbf8-4c3d-8708-e8348bc864f0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:37 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-372b400d-bbf8-4c3d-8708-e8348bc864f0 Jul 04 00:07:37 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:37 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-372b400d-bbf8-4c3d-8708-e8348bc864f0" returned: 0 in 0.723s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:07:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:07:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8121b9c4-1f61-4c71-8034-1feea7bb6b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-372b400d-bbf8-4c3d-8708-e8348bc864f0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa741da-b53c-45c0-aabe-73cd4fcd6cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:37 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Volume volume-372b400d-bbf8-4c3d-8708-e8348bc864f0 (372b400d-bbf8-4c3d-8708-e8348bc864f0): created successfully Jul 04 00:07:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa741da-b53c-45c0-aabe-73cd4fcd6cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Flow 'volume_create_manager' (e3160209-b57e-4462-aa8e-6436a93f4484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:07:37 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fb36e848-18da-45a7-a171-3653258eed94 tempest-ProjectReaderTests-135048488 None] Created volume successfully. Jul 04 00:07:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] Acquiring lock "cinder-372b400d-bbf8-4c3d-8708-e8348bc864f0-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:07:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] Lock "cinder-372b400d-bbf8-4c3d-8708-e8348bc864f0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:07:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] Acquiring lock "cinder-quobyte-372b400d-bbf8-4c3d-8708-e8348bc864f0" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:07:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] Lock "cinder-quobyte-372b400d-bbf8-4c3d-8708-e8348bc864f0" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:07:39 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d4d23b-d753-45b1-b1b8-d090e81e6965]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:07:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-372b400d-bbf8-4c3d-8708-e8348bc864f0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:39 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-372b400d-bbf8-4c3d-8708-e8348bc864f0 Jul 04 00:07:39 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:40 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-372b400d-bbf8-4c3d-8708-e8348bc864f0" returned: 0 in 0.922s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-372b400d-bbf8-4c3d-8708-e8348bc864f0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:40 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-372b400d-bbf8-4c3d-8708-e8348bc864f0 Jul 04 00:07:40 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:41 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-372b400d-bbf8-4c3d-8708-e8348bc864f0" returned: 0 in 0.923s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] Lock "cinder-quobyte-372b400d-bbf8-4c3d-8708-e8348bc864f0" released by "delete_volume" :: held 1.924s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] Created reservations ['6a1ebbd3-ae11-420d-bf1f-54c56d04bf0c', 'f81bf0b4-586a-421c-9757-975d6c8e3ad2', '523f6bbe-2dc7-4a6c-920d-760605df04df', 'c6bef227-21f3-4027-8bff-c004cb85815c'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:41 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:07:41 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Flow 'volume_create_manager' (3cc1ffd9-3ef0-4bf2-83c5-e7116986b214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722dd853-fc78-49a6-9674-9d9185b1faad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722dd853-fc78-49a6-9674-9d9185b1faad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1442385645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b4e3ea-186c-4377-866b-bcaa0c348f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553a23ff48b4a5b8b0fa874776b8a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:42Z,use_quota=True,user_id='43f6840351db4953aa9ce655c9bfb187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cfac0c-23d2-4648-8f8a-bbc0a82f0d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cfac0c-23d2-4648-8f8a-bbc0a82f0d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e5b95b-b5b6-41ab-ae53-e985847911bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e5b95b-b5b6-41ab-ae53-e985847911bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b4e3ea-186c-4377-866b-bcaa0c348f70', 'volume_name': 'volume-66b4e3ea-186c-4377-866b-bcaa0c348f70', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15867fc9-dd6c-42cd-a505-e9c8564f5dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15867fc9-dd6c-42cd-a505-e9c8564f5dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464f2cce-9b60-4f61-ba77-5b6a4e46181a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:41 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Volume 66b4e3ea-186c-4377-866b-bcaa0c348f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b4e3ea-186c-4377-866b-bcaa0c348f70', 'volume_size': 1} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1442385645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b4e3ea-186c-4377-866b-bcaa0c348f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553a23ff48b4a5b8b0fa874776b8a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:42Z,use_quota=True,user_id='43f6840351db4953aa9ce655c9bfb187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Creating volume 66b4e3ea-186c-4377-866b-bcaa0c348f70 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:07:41 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:07:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66b4e3ea-186c-4377-866b-bcaa0c348f70 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:42 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66b4e3ea-186c-4377-866b-bcaa0c348f70 1073741824 Jul 04 00:07:42 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:42 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.830s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:42 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:07:42 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] Deleted volume successfully. Jul 04 00:07:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cbde39a1-2abc-4991-a358-dd36863955ae tempest-ProjectReaderTests-135048488 None] Lock "cinder-372b400d-bbf8-4c3d-8708-e8348bc864f0-delete_volume" released by "delete_volume" :: held 3.055s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:07:42 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66b4e3ea-186c-4377-866b-bcaa0c348f70 1073741824" returned: 0 in 0.916s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66b4e3ea-186c-4377-866b-bcaa0c348f70 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:42 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66b4e3ea-186c-4377-866b-bcaa0c348f70 Jul 04 00:07:42 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:43 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66b4e3ea-186c-4377-866b-bcaa0c348f70" returned: 0 in 0.752s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:07:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:07:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464f2cce-9b60-4f61-ba77-5b6a4e46181a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b4e3ea-186c-4377-866b-bcaa0c348f70', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbf3850-0df6-470b-bb3c-d2988e09438a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:43 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Volume volume-66b4e3ea-186c-4377-866b-bcaa0c348f70 (66b4e3ea-186c-4377-866b-bcaa0c348f70): created successfully Jul 04 00:07:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbf3850-0df6-470b-bb3c-d2988e09438a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Flow 'volume_create_manager' (3cc1ffd9-3ef0-4bf2-83c5-e7116986b214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:07:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e7b5bbaf-ea07-487b-a564-ff24bb8b2270 tempest-ProjectReaderTests-135048488 None] Created volume successfully. Jul 04 00:07:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] Acquiring lock "cinder-66b4e3ea-186c-4377-866b-bcaa0c348f70-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:07:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] Lock "cinder-66b4e3ea-186c-4377-866b-bcaa0c348f70-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:07:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] Acquiring lock "cinder-quobyte-66b4e3ea-186c-4377-866b-bcaa0c348f70" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:07:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] Lock "cinder-quobyte-66b4e3ea-186c-4377-866b-bcaa0c348f70" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:07:44 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e28adb-19f8-4e57-aebc-52014d70d402]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:07:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66b4e3ea-186c-4377-866b-bcaa0c348f70 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:44 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66b4e3ea-186c-4377-866b-bcaa0c348f70 Jul 04 00:07:44 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:45 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66b4e3ea-186c-4377-866b-bcaa0c348f70" returned: 0 in 0.860s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66b4e3ea-186c-4377-866b-bcaa0c348f70 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:45 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66b4e3ea-186c-4377-866b-bcaa0c348f70 Jul 04 00:07:45 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:45 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66b4e3ea-186c-4377-866b-bcaa0c348f70" returned: 0 in 0.749s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] Lock "cinder-quobyte-66b4e3ea-186c-4377-866b-bcaa0c348f70" released by "delete_volume" :: held 1.655s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:07:45 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] Created reservations ['764268fe-e1b0-4391-a446-355253a1c6fd', '16c95028-a014-4e32-891c-9cbcb366d2c2', '2e2c6c8b-d807-43e9-a613-389055e990f3', 'be4fdb44-b438-48b4-b2a4-e083fa219235'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:07:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:07:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:07:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:07:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:07:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:07:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:46 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:07:46 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:46 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.788s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:46 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:07:46 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] Deleted volume successfully. Jul 04 00:07:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2050b83a-3be4-44ab-b016-b577b0b74497 tempest-ProjectReaderTests-135048488 None] Lock "cinder-66b4e3ea-186c-4377-866b-bcaa0c348f70-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:07:46 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:07:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Flow 'volume_create_manager' (e2f90d3e-68c0-487a-b335-d8fdff26a0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:07:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97a08a2-7b71-445d-bd40-065397a8040f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97a08a2-7b71-445d-bd40-065397a8040f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-727025298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f74deb7-be29-4e79-8886-b1fbc8aeb35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553a23ff48b4a5b8b0fa874776b8a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:47Z,use_quota=True,user_id='43f6840351db4953aa9ce655c9bfb187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336be0dd-c483-418d-8ae6-a080cdcef0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336be0dd-c483-418d-8ae6-a080cdcef0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c46630-aa27-424b-bf49-0fdcc8a339f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c46630-aa27-424b-bf49-0fdcc8a339f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f74deb7-be29-4e79-8886-b1fbc8aeb35d', 'volume_name': 'volume-3f74deb7-be29-4e79-8886-b1fbc8aeb35d', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7dc387-f2bb-4ae4-bf3f-67756c7fca77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7dc387-f2bb-4ae4-bf3f-67756c7fca77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79272774-df85-4f6d-ad10-f9de3b554d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:47 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Volume 3f74deb7-be29-4e79-8886-b1fbc8aeb35d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f74deb7-be29-4e79-8886-b1fbc8aeb35d', 'volume_size': 1} Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-727025298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f74deb7-be29-4e79-8886-b1fbc8aeb35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553a23ff48b4a5b8b0fa874776b8a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:47Z,use_quota=True,user_id='43f6840351db4953aa9ce655c9bfb187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Creating volume 3f74deb7-be29-4e79-8886-b1fbc8aeb35d {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:07:47 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3f74deb7-be29-4e79-8886-b1fbc8aeb35d 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:47 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3f74deb7-be29-4e79-8886-b1fbc8aeb35d 1073741824 Jul 04 00:07:47 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:47 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3f74deb7-be29-4e79-8886-b1fbc8aeb35d 1073741824" returned: 0 in 0.888s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3f74deb7-be29-4e79-8886-b1fbc8aeb35d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:48 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3f74deb7-be29-4e79-8886-b1fbc8aeb35d Jul 04 00:07:48 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:48 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3f74deb7-be29-4e79-8886-b1fbc8aeb35d" returned: 0 in 0.669s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:07:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:07:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79272774-df85-4f6d-ad10-f9de3b554d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f74deb7-be29-4e79-8886-b1fbc8aeb35d', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169c1810-40e9-4e6d-af70-d991b2cad649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:07:48 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Volume volume-3f74deb7-be29-4e79-8886-b1fbc8aeb35d (3f74deb7-be29-4e79-8886-b1fbc8aeb35d): created successfully Jul 04 00:07:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169c1810-40e9-4e6d-af70-d991b2cad649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:07:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Flow 'volume_create_manager' (e2f90d3e-68c0-487a-b335-d8fdff26a0a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:07:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d7f882c8-8ca3-4d31-b2b2-b6439b8cd924 tempest-ProjectReaderTests-135048488 None] Created volume successfully. Jul 04 00:07:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] Acquiring lock "cinder-3f74deb7-be29-4e79-8886-b1fbc8aeb35d-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:07:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] Lock "cinder-3f74deb7-be29-4e79-8886-b1fbc8aeb35d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:07:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] Acquiring lock "cinder-quobyte-3f74deb7-be29-4e79-8886-b1fbc8aeb35d" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:07:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] Lock "cinder-quobyte-3f74deb7-be29-4e79-8886-b1fbc8aeb35d" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:07:49 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a613eee8-49ec-4116-a4cc-7a07265da7d5]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:07:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3f74deb7-be29-4e79-8886-b1fbc8aeb35d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:49 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3f74deb7-be29-4e79-8886-b1fbc8aeb35d Jul 04 00:07:49 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:49 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3f74deb7-be29-4e79-8886-b1fbc8aeb35d" returned: 0 in 0.779s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3f74deb7-be29-4e79-8886-b1fbc8aeb35d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:49 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3f74deb7-be29-4e79-8886-b1fbc8aeb35d Jul 04 00:07:49 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:50 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-3f74deb7-be29-4e79-8886-b1fbc8aeb35d" returned: 0 in 0.665s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] Lock "cinder-quobyte-3f74deb7-be29-4e79-8886-b1fbc8aeb35d" released by "delete_volume" :: held 1.494s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:07:50 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] Created reservations ['1b8f7630-a1c6-4693-b2fd-3b77977dcd5f', '06c152cc-fd94-4a16-85da-cf84e89d44ed', '68af7bdd-8507-4ec1-827e-3d753baaf0fe', 'ddb9b4d9-964b-4b62-9ea3-aaa29fc5637d'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:07:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:07:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:07:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:07:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:07:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:07:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:07:50 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:07:50 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:07:51 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Jul 04 00:07:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.720s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:07:51 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:07:51 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] Deleted volume successfully. Jul 04 00:07:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-83918afc-eac2-4903-8328-920bcbd05eda tempest-ProjectReaderTests-135048488 None] Lock "cinder-3f74deb7-be29-4e79-8886-b1fbc8aeb35d-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:08:00 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=34,cinder:UPDATE=45,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:08:01 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=35,cinder:UPDATE=46,cinder:DELETE=6,cinder:INSERT=11 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:08:24 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-af4cf33e-724b-4332-b942-82a335b8d35c tempest-TestShelveInstance-1606346922 None] Terminate volume connection completed successfully. Jul 04 00:08:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-af4cf33e-724b-4332-b942-82a335b8d35c tempest-TestShelveInstance-1606346922 None] Deleting attachment e4a2ae0c-9cd0-4866-b86c-892c4a597c5e. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 04 00:08:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] Acquiring lock "cinder-51692d98-f01e-4a3f-a685-030f6cde638f-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:08:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] Lock "cinder-51692d98-f01e-4a3f-a685-030f6cde638f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:08:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] Acquiring lock "cinder-quobyte-51692d98-f01e-4a3f-a685-030f6cde638f" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:08:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] Lock "cinder-quobyte-51692d98-f01e-4a3f-a685-030f6cde638f" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:08:25 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[afebbc59-06e0-4a13-b7f8-efb03a07a5fc]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:08:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:08:25 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f Jul 04 00:08:25 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:08:26 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Jul 04 00:08:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f" returned: 0 in 0.760s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:08:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:08:26 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f Jul 04 00:08:26 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:08:27 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Jul 04 00:08:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f" returned: 1 in 0.751s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:08:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:08:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:08:27 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f Jul 04 00:08:27 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:08:27 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Jul 04 00:08:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-51692d98-f01e-4a3f-a685-030f6cde638f" returned: 0 in 0.678s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:08:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] Lock "cinder-quobyte-51692d98-f01e-4a3f-a685-030f6cde638f" released by "delete_volume" :: held 2.253s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:08:27 devstack cinder-volume[86676]: DEBUG cinder.quota [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] Created reservations ['92cfaf06-cb5c-40b3-a831-ca41e4702fc1', '72a4619f-5297-456e-8021-bac3b8f0ea18', '53e59992-48c3-41ec-b678-3c21a7c4b3ef', 'f5ecf58e-ea45-45c2-8181-874111034e56'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:08:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:08:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:08:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:08:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:08:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:08:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:08:27 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:08:27 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:08:28 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Jul 04 00:08:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.751s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:08:28 devstack cinder-volume[86676]: DEBUG cinder.manager [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:08:28 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] Deleted volume successfully. Jul 04 00:08:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-8fd921c1-d6cf-41af-bbe4-912e89ad1fe6 req-8c240e29-257d-4d7c-b667-622919913b32 tempest-TestShelveInstance-1606346922 None] Lock "cinder-51692d98-f01e-4a3f-a685-030f6cde638f-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:08:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:08:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:08:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:08:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:08:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:08:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:08:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:08:33 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:08:33 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:08:34 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Jul 04 00:08:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.726s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:08:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:08:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:08:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:08:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:08:37 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:08:38 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Flow 'volume_create_manager' (2011ba86-e64d-49ab-9d40-965c61e7d3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbfd2120-9943-4e1d-a66a-3cefc80ed07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbfd2120-9943-4e1d-a66a-3cefc80ed07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1525120795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211a04792cb54e5dbfb1e170d6f8f5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:09:03Z,use_quota=True,user_id='26df6fea7f314de294a6184521609c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4931d85f-f69b-404e-946b-dd7c571204c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4931d85f-f69b-404e-946b-dd7c571204c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7a7f18-a748-4463-95fd-4fcaf52bdad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7a7f18-a748-4463-95fd-4fcaf52bdad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30', 'volume_name': 'volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb76bde0-993d-4b47-b127-655c0a653efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb76bde0-993d-4b47-b127-655c0a653efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05558317-9d16-4daa-a345-316f14a10ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:09:02 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Volume 1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30', 'volume_size': 1} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1525120795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211a04792cb54e5dbfb1e170d6f8f5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:09:03Z,use_quota=True,user_id='26df6fea7f314de294a6184521609c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Creating volume 1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:09:02 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:09:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:09:02 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 1073741824 Jul 04 00:09:02 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:09:03 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Jul 04 00:09:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 1073741824" returned: 0 in 0.899s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:09:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:09:03 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 Jul 04 00:09:03 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:09:04 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Jul 04 00:09:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30" returned: 0 in 0.727s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:09:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:09:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:09:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05558317-9d16-4daa-a345-316f14a10ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:09:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98c2bef-266d-4f19-9e5f-102ae8ccb481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:09:04 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Volume volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 (1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30): created successfully Jul 04 00:09:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98c2bef-266d-4f19-9e5f-102ae8ccb481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:09:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Flow 'volume_create_manager' (2011ba86-e64d-49ab-9d40-965c61e7d3bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:09:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8e096019-ed72-4724-8323-ed65b9e19d74 tempest-TestStampPattern-3819160 None] Created volume successfully. Jul 04 00:09:14 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=3,cinder:UPDATE=6 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:09:14 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:09:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:09:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:09:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:09:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:09:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:09:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:09:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:09:33 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:09:33 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:09:34 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Jul 04 00:09:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.638s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:09:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:09:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:09:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:09:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:09:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-81369a6e-d4b6-433c-895c-c693e75b9992 req-0c40b2b1-a984-4869-851a-2ba93c1e9954 tempest-TestStampPattern-3819160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:09:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-81369a6e-d4b6-433c-895c-c693e75b9992 req-0c40b2b1-a984-4869-851a-2ba93c1e9954 tempest-TestStampPattern-3819160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:09:43 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e19dd5-6b33-4edd-b9c7-12a3e6faaf9d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:09:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-81369a6e-d4b6-433c-895c-c693e75b9992 req-0c40b2b1-a984-4869-851a-2ba93c1e9954 tempest-TestStampPattern-3819160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:09:43 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 Jul 04 00:09:43 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:09:44 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Jul 04 00:09:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-81369a6e-d4b6-433c-895c-c693e75b9992 req-0c40b2b1-a984-4869-851a-2ba93c1e9954 tempest-TestStampPattern-3819160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30" returned: 0 in 0.785s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:09:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-81369a6e-d4b6-433c-895c-c693e75b9992 req-0c40b2b1-a984-4869-851a-2ba93c1e9954 tempest-TestStampPattern-3819160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.803s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:09:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-81369a6e-d4b6-433c-895c-c693e75b9992 req-0c40b2b1-a984-4869-851a-2ba93c1e9954 tempest-TestStampPattern-3819160 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc315436-4621-4425-a084-f7f01f8d2391', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 04 00:09:44 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-81369a6e-d4b6-433c-895c-c693e75b9992 req-0c40b2b1-a984-4869-851a-2ba93c1e9954 tempest-TestStampPattern-3819160 None] attachment_update completed successfully. Jul 04 00:09:52 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-2be7e57d-e875-4a27-9cb0-d96dbcca9b3c req-291a54ce-4013-4f91-bf23-64bee4e9a174 tempest-TestStampPattern-3819160 None] Terminate volume connection completed successfully. Jul 04 00:09:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-2be7e57d-e875-4a27-9cb0-d96dbcca9b3c req-291a54ce-4013-4f91-bf23-64bee4e9a174 tempest-TestStampPattern-3819160 None] Deleting attachment bc315436-4621-4425-a084-f7f01f8d2391. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 04 00:09:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e3945ab6-9b96-47c0-bd6c-b8d6d08a5ce1 tempest-TestStampPattern-3819160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:09:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e3945ab6-9b96-47c0-bd6c-b8d6d08a5ce1 tempest-TestStampPattern-3819160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:09:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e3945ab6-9b96-47c0-bd6c-b8d6d08a5ce1 tempest-TestStampPattern-3819160 None] Creating offline snapshot 8d085915-cd97-4968-a0fe-89ff1ffcea86 of volume 1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:09:54 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccbf15b-db36-4c79-909e-c3721f268eb3]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:09:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3945ab6-9b96-47c0-bd6c-b8d6d08a5ce1 tempest-TestStampPattern-3819160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:09:54 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 Jul 04 00:09:54 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:09:55 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Jul 04 00:09:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3945ab6-9b96-47c0-bd6c-b8d6d08a5ce1 tempest-TestStampPattern-3819160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30" returned: 0 in 0.792s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:09:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3945ab6-9b96-47c0-bd6c-b8d6d08a5ce1 tempest-TestStampPattern-3819160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:09:55 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86 1G Jul 04 00:09:55 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:09:56 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Jul 04 00:09:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3945ab6-9b96-47c0-bd6c-b8d6d08a5ce1 tempest-TestStampPattern-3819160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86 1G" returned: 0 in 0.821s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:09:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3945ab6-9b96-47c0-bd6c-b8d6d08a5ce1 tempest-TestStampPattern-3819160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:09:56 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86 Jul 04 00:09:56 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:09:57 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Jul 04 00:09:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3945ab6-9b96-47c0-bd6c-b8d6d08a5ce1 tempest-TestStampPattern-3819160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86" returned: 0 in 0.707s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:09:57 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-e3945ab6-9b96-47c0-bd6c-b8d6d08a5ce1 tempest-TestStampPattern-3819160 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86 is being set with open permissions: ugo+rw Jul 04 00:09:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3945ab6-9b96-47c0-bd6c-b8d6d08a5ce1 tempest-TestStampPattern-3819160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:09:57 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86 Jul 04 00:09:57 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:09:57 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Jul 04 00:09:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3945ab6-9b96-47c0-bd6c-b8d6d08a5ce1 tempest-TestStampPattern-3819160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86" returned: 0 in 0.642s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:09:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3945ab6-9b96-47c0-bd6c-b8d6d08a5ce1 tempest-TestStampPattern-3819160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:09:57 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.info Jul 04 00:09:57 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:09:58 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Jul 04 00:09:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3945ab6-9b96-47c0-bd6c-b8d6d08a5ce1 tempest-TestStampPattern-3819160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.info" returned: 0 in 0.643s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:09:58 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-e3945ab6-9b96-47c0-bd6c-b8d6d08a5ce1 tempest-TestStampPattern-3819160 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.info is being set with open permissions: ugo+rw Jul 04 00:09:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3945ab6-9b96-47c0-bd6c-b8d6d08a5ce1 tempest-TestStampPattern-3819160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:09:58 devstack sudo[103070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.info Jul 04 00:09:58 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:09:59 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root Jul 04 00:09:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3945ab6-9b96-47c0-bd6c-b8d6d08a5ce1 tempest-TestStampPattern-3819160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.info" returned: 0 in 0.658s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:09:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e3945ab6-9b96-47c0-bd6c-b8d6d08a5ce1 tempest-TestStampPattern-3819160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.352s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:09:59 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e3945ab6-9b96-47c0-bd6c-b8d6d08a5ce1 tempest-TestStampPattern-3819160 None] Create snapshot completed successfully Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=9,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=11,cinder:DELETE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Flow 'volume_create_manager' (54c28280-6325-436d-bd79-3ebe764b7957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee73cc2-4395-49cf-ba96-7bbe604baf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee73cc2-4395-49cf-ba96-7bbe604baf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1619700222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fede0df-021e-422c-a0a0-5d51e9e48b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211a04792cb54e5dbfb1e170d6f8f5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8d085915-cd97-4968-a0fe-89ff1ffcea86,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:10:10Z,use_quota=True,user_id='26df6fea7f314de294a6184521609c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78017ed-045d-47d8-ae43-a732f5508473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78017ed-045d-47d8-ae43-a732f5508473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c2ca93-ac8a-4766-bda3-ca041d34f42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c2ca93-ac8a-4766-bda3-ca041d34f42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1fede0df-021e-422c-a0a0-5d51e9e48b77', 'volume_name': 'volume-1fede0df-021e-422c-a0a0-5d51e9e48b77', 'volume_size': 1, 'snapshot_id': '8d085915-cd97-4968-a0fe-89ff1ffcea86'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811da065-fdc4-4ceb-9923-5623441ffe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811da065-fdc4-4ceb-9923-5623441ffe27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9ab0cf-e2c6-4573-a1d3-6696a0dfa51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:10:09 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Volume 1fede0df-021e-422c-a0a0-5d51e9e48b77: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1fede0df-021e-422c-a0a0-5d51e9e48b77', 'volume_size': 1, 'snapshot_id': '8d085915-cd97-4968-a0fe-89ff1ffcea86'} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Acquiring lock "cinder-quobyte-8d085915-cd97-4968-a0fe-89ff1ffcea86-1fede0df-021e-422c-a0a0-5d51e9e48b77" by "_create_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Lock "cinder-quobyte-8d085915-cd97-4968-a0fe-89ff1ffcea86-1fede0df-021e-422c-a0a0-5d51e9e48b77" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Creating volume 1fede0df-021e-422c-a0a0-5d51e9e48b77 from snapshot 8d085915-cd97-4968-a0fe-89ff1ffcea86 {{(pid=86676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Acquiring lock "cinder-quobyte-1fede0df-021e-422c-a0a0-5d51e9e48b77" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Lock "cinder-quobyte-1fede0df-021e-422c-a0a0-5d51e9e48b77" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:10:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] snapshot: 8d085915-cd97-4968-a0fe-89ff1ffcea86, volume: 1fede0df-021e-422c-a0a0-5d51e9e48b77, {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 04 00:10:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:10:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:10:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:10:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:10:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:10:10 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[662d2d7e-2d48-4ffc-a8b9-cd8d61663baa]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:10:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:10:10 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86 Jul 04 00:10:10 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:10:10 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Jul 04 00:10:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86" returned: 0 in 0.858s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:10:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:10:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 04 00:10:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 04 00:10:10 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b280c7-a0c3-4088-8f4d-e0ebd51cbcbf]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:10:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:10:11 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 Jul 04 00:10:11 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:10:11 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Jul 04 00:10:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30" returned: 0 in 0.863s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:10:11 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Path /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1fede0df-021e-422c-a0a0-5d51e9e48b77 not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 04 00:10:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1fede0df-021e-422c-a0a0-5d51e9e48b77 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:10:11 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1fede0df-021e-422c-a0a0-5d51e9e48b77 Jul 04 00:10:11 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:10:17 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Jul 04 00:10:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1fede0df-021e-422c-a0a0-5d51e9e48b77" returned: 0 in 5.212s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:10:17 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fd9a75-7aaf-42d9-9e11-103dbad8f821]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:10:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:10:17 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 Jul 04 00:10:17 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:10:18 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Jul 04 00:10:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30" returned: 0 in 1.273s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:10:18 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1fede0df-021e-422c-a0a0-5d51e9e48b77 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 04 00:10:18 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Converted 1024.00 MB image at 196.42 MB/s Jul 04 00:10:18 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1fede0df-021e-422c-a0a0-5d51e9e48b77 is being set with open permissions: ugo+rw Jul 04 00:10:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1fede0df-021e-422c-a0a0-5d51e9e48b77 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:10:18 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1fede0df-021e-422c-a0a0-5d51e9e48b77 Jul 04 00:10:18 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:10:19 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Jul 04 00:10:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1fede0df-021e-422c-a0a0-5d51e9e48b77" returned: 0 in 0.925s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:10:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Lock "cinder-quobyte-1fede0df-021e-422c-a0a0-5d51e9e48b77" released by "_copy_volume_from_snapshot" :: held 9.287s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:10:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Lock "cinder-quobyte-8d085915-cd97-4968-a0fe-89ff1ffcea86-1fede0df-021e-422c-a0a0-5d51e9e48b77" released by "_create_volume_from_snapshot" :: held 9.334s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:10:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.352s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:10:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9ab0cf-e2c6-4573-a1d3-6696a0dfa51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fede0df-021e-422c-a0a0-5d51e9e48b77', 'volume_size': 1, 'snapshot_id': '8d085915-cd97-4968-a0fe-89ff1ffcea86'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:10:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4cf3dd-1bee-4a70-973c-65db09dfd11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:10:19 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Volume volume-1fede0df-021e-422c-a0a0-5d51e9e48b77 (1fede0df-021e-422c-a0a0-5d51e9e48b77): created successfully Jul 04 00:10:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4cf3dd-1bee-4a70-973c-65db09dfd11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:10:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Flow 'volume_create_manager' (54c28280-6325-436d-bd79-3ebe764b7957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:10:19 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a83969d8-fdac-4c57-afef-969d03db9b2b tempest-TestStampPattern-3819160 None] Created volume successfully. Jul 04 00:10:29 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:10:29 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:10:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:10:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:10:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:10:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:10:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:10:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:10:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:10:33 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:10:33 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:10:34 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Jul 04 00:10:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.633s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:10:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:10:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:10:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:10:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:10:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-6851a073-8520-4c82-b6e0-5cc9bb371090 req-f26e3acc-da7e-4c1d-a5ed-3fa7e2f7f1a4 tempest-TestStampPattern-3819160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:10:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-6851a073-8520-4c82-b6e0-5cc9bb371090 req-f26e3acc-da7e-4c1d-a5ed-3fa7e2f7f1a4 tempest-TestStampPattern-3819160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:10:54 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b2b3c1-fdf4-4a4d-902c-23ba772d567f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:10:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-6851a073-8520-4c82-b6e0-5cc9bb371090 req-f26e3acc-da7e-4c1d-a5ed-3fa7e2f7f1a4 tempest-TestStampPattern-3819160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1fede0df-021e-422c-a0a0-5d51e9e48b77 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:10:54 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1fede0df-021e-422c-a0a0-5d51e9e48b77 Jul 04 00:10:54 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:10:55 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Jul 04 00:10:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-6851a073-8520-4c82-b6e0-5cc9bb371090 req-f26e3acc-da7e-4c1d-a5ed-3fa7e2f7f1a4 tempest-TestStampPattern-3819160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1fede0df-021e-422c-a0a0-5d51e9e48b77" returned: 0 in 0.753s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:10:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-6851a073-8520-4c82-b6e0-5cc9bb371090 req-f26e3acc-da7e-4c1d-a5ed-3fa7e2f7f1a4 tempest-TestStampPattern-3819160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.769s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:10:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-6851a073-8520-4c82-b6e0-5cc9bb371090 req-f26e3acc-da7e-4c1d-a5ed-3fa7e2f7f1a4 tempest-TestStampPattern-3819160 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964', 'name': 'volume-1fede0df-021e-422c-a0a0-5d51e9e48b77', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22dee263-69c3-4c00-95fb-9001d3f71078', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 04 00:10:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-6851a073-8520-4c82-b6e0-5cc9bb371090 req-f26e3acc-da7e-4c1d-a5ed-3fa7e2f7f1a4 tempest-TestStampPattern-3819160 None] attachment_update completed successfully. Jul 04 00:11:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-b069f220-ea43-4713-8fee-2f7f81457f3b req-64fbf610-baa0-4b7e-a253-f6f19b1eef5f tempest-TestStampPattern-3819160 None] Terminate volume connection completed successfully. Jul 04 00:11:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-b069f220-ea43-4713-8fee-2f7f81457f3b req-64fbf610-baa0-4b7e-a253-f6f19b1eef5f tempest-TestStampPattern-3819160 None] Deleting attachment 22dee263-69c3-4c00-95fb-9001d3f71078. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 04 00:11:11 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:11:11 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:11:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] Acquiring lock "cinder-1fede0df-021e-422c-a0a0-5d51e9e48b77-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:11:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] Lock "cinder-1fede0df-021e-422c-a0a0-5d51e9e48b77-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:11:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] Acquiring lock "cinder-quobyte-1fede0df-021e-422c-a0a0-5d51e9e48b77" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:11:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] Lock "cinder-quobyte-1fede0df-021e-422c-a0a0-5d51e9e48b77" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:11:11 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0d8b19-2efe-404f-94f7-f22d794d34ae]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:11:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1fede0df-021e-422c-a0a0-5d51e9e48b77 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:12 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1fede0df-021e-422c-a0a0-5d51e9e48b77 Jul 04 00:11:12 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:12 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1fede0df-021e-422c-a0a0-5d51e9e48b77" returned: 0 in 0.751s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1fede0df-021e-422c-a0a0-5d51e9e48b77 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:12 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1fede0df-021e-422c-a0a0-5d51e9e48b77 Jul 04 00:11:12 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:13 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1fede0df-021e-422c-a0a0-5d51e9e48b77" returned: 0 in 0.664s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] Lock "cinder-quobyte-1fede0df-021e-422c-a0a0-5d51e9e48b77" released by "delete_volume" :: held 1.454s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:11:13 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] Created reservations ['9ba9ce71-200c-43ad-8b64-ac21f61c00c7', '28b78018-d82c-4ae7-a087-7b064605d27e', '37d865cf-7dd6-4186-b2dd-337f68386609', 'e225d2f5-0247-4808-9477-61600d36e69d'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:11:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:11:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:11:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:11:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:11:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:11:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:13 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:11:13 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:14 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.676s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:14 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:11:14 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] Deleted volume successfully. Jul 04 00:11:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7dcd600c-c03f-4b81-9301-3e36b8c1c82a tempest-TestStampPattern-3819160 None] Lock "cinder-1fede0df-021e-422c-a0a0-5d51e9e48b77-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:11:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] Acquiring lock "cinder-8d085915-cd97-4968-a0fe-89ff1ffcea86-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:11:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] Lock "cinder-8d085915-cd97-4968-a0fe-89ff1ffcea86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:11:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] Acquiring lock "cinder-quobyte-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:11:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] Lock "cinder-quobyte-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:11:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] Acquiring lock "cinder-quobyte-8d085915-cd97-4968-a0fe-89ff1ffcea86" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:11:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] Lock "cinder-quobyte-8d085915-cd97-4968-a0fe-89ff1ffcea86" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:11:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] Deleting offline snapshot 8d085915-cd97-4968-a0fe-89ff1ffcea86 of volume 1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:11:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] snapshot_file for this snap is: volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:11:14 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b45f5d7-9e95-43ed-a781-b10e8854962a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:11:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:14 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86 Jul 04 00:11:14 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:15 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86" returned: 0 in 0.774s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:11:15 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1045a7-ddc3-4ca8-9df4-bdf9bbbcc1f0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:11:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:15 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 Jul 04 00:11:15 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:16 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30" returned: 0 in 0.770s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:16 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86 Jul 04 00:11:16 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:16 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86" returned: 0 in 0.734s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:16 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86 Jul 04 00:11:16 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:17 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30.8d085915-cd97-4968-a0fe-89ff1ffcea86" returned: 0 in 0.638s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] Lock "cinder-quobyte-8d085915-cd97-4968-a0fe-89ff1ffcea86" released by "_delete_snapshot" :: held 3.013s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:11:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] Lock "cinder-quobyte-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30" released by "delete_snapshot" :: held 3.036s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:11:17 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] Created reservations ['d761cf3a-c8ed-40da-bfe3-0f685b82bc84', '3907e99a-1da4-4700-9cb7-bd38bde33bb0', 'a890f04a-64c6-436a-8ea8-54a398bc19eb', 'd8da3563-6313-4bcb-8c87-63cf3f43bed3'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:11:17 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] Delete snapshot completed successfully. Jul 04 00:11:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-117aae3f-6aca-4204-84c5-a79b9dd8adbd tempest-TestStampPattern-3819160 None] Lock "cinder-8d085915-cd97-4968-a0fe-89ff1ffcea86-delete_snapshot" released by "delete_snapshot" :: held 3.190s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:11:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] Acquiring lock "cinder-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:11:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] Lock "cinder-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:11:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] Acquiring lock "cinder-quobyte-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:11:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] Lock "cinder-quobyte-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:11:26 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0bc2db-0c89-431b-b5e2-2ae850aa81b6]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:11:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:26 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 Jul 04 00:11:26 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:27 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30" returned: 0 in 0.749s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:27 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30 Jul 04 00:11:27 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:28 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30" returned: 0 in 0.639s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] Lock "cinder-quobyte-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30" released by "delete_volume" :: held 1.442s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:11:28 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] Created reservations ['d1a849bc-63fe-4fdc-94a7-72c219c906cd', 'fee35435-b14a-4fb7-80da-b879bbbf2797', '6d032400-888f-47f3-bf59-13735cf54912', 'a259bfa3-11cf-4082-99fd-26154a754e8a'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:11:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:11:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:11:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:11:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:11:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:11:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:28 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:11:28 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:29 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.674s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:29 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:11:29 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] Deleted volume successfully. Jul 04 00:11:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-09f9193e-fecf-4e53-ac90-31e47afa22f8 tempest-TestStampPattern-3819160 None] Lock "cinder-1ed81ddd-0e5a-4ad3-a163-dc7d46af1b30-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:11:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:11:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:11:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:11:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:11:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:11:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:11:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:33 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:11:33 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:34 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.648s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:11:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:11:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:11:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:11:38 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=23,cinder:SELECT=15,cinder:INSERT=5 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=16,cinder:INSERT=7,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Flow 'volume_create_manager' (63ead6d7-41dc-4635-8466-11d49befbcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (691639cd-e6b0-4c8b-8c9a-102a57ac35ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (691639cd-e6b0-4c8b-8c9a-102a57ac35ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-365349351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee28402-e59c-480a-8aad-a82f3df653a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099c70afca7d4f509d1367d87b9937f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:40Z,use_quota=True,user_id='5d40d22970da4445ad775cd76cadcbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca77a45-cb2d-4dd2-8ca5-a2ebf7c1d31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca77a45-cb2d-4dd2-8ca5-a2ebf7c1d31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfabf6d3-8308-471d-9fd2-aae83ffeda08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfabf6d3-8308-471d-9fd2-aae83ffeda08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bee28402-e59c-480a-8aad-a82f3df653a7', 'volume_name': 'volume-bee28402-e59c-480a-8aad-a82f3df653a7', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4481d70-859a-405e-8bfe-e74e1a587744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4481d70-859a-405e-8bfe-e74e1a587744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37102ee3-efbe-4bc4-a080-ab849bd1bd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:39 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Volume bee28402-e59c-480a-8aad-a82f3df653a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bee28402-e59c-480a-8aad-a82f3df653a7', 'volume_size': 1} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-365349351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee28402-e59c-480a-8aad-a82f3df653a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099c70afca7d4f509d1367d87b9937f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:40Z,use_quota=True,user_id='5d40d22970da4445ad775cd76cadcbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Creating volume bee28402-e59c-480a-8aad-a82f3df653a7 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:11:39 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:11:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:39 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7 1073741824 Jul 04 00:11:39 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:40 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7 1073741824" returned: 0 in 0.789s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:40 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7 Jul 04 00:11:40 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:41 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7" returned: 0 in 0.626s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:11:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:11:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37102ee3-efbe-4bc4-a080-ab849bd1bd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bee28402-e59c-480a-8aad-a82f3df653a7', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647224da-6205-43d6-82ba-540a92705056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:41 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Volume volume-bee28402-e59c-480a-8aad-a82f3df653a7 (bee28402-e59c-480a-8aad-a82f3df653a7): created successfully Jul 04 00:11:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647224da-6205-43d6-82ba-540a92705056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Flow 'volume_create_manager' (63ead6d7-41dc-4635-8466-11d49befbcb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:11:41 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9a36bcd0-6617-493d-8524-a2ccf8970efa tempest-CreateVolumesFromSnapshotTest-1884125868 None] Created volume successfully. Jul 04 00:11:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8b5dbdd0-17c0-4fa7-9649-c2acb64844c2 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:11:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8b5dbdd0-17c0-4fa7-9649-c2acb64844c2 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:11:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8b5dbdd0-17c0-4fa7-9649-c2acb64844c2 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Creating offline snapshot ca515896-868d-44c0-8775-9e5e26e0cc01 of volume bee28402-e59c-480a-8aad-a82f3df653a7 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:11:42 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d9cdad-294d-42db-8e1f-8dc1f2d59a61]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:11:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8b5dbdd0-17c0-4fa7-9649-c2acb64844c2 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:42 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7 Jul 04 00:11:42 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:42 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8b5dbdd0-17c0-4fa7-9649-c2acb64844c2 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7" returned: 0 in 0.760s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8b5dbdd0-17c0-4fa7-9649-c2acb64844c2 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:42 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01 1G Jul 04 00:11:42 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:43 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8b5dbdd0-17c0-4fa7-9649-c2acb64844c2 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01 1G" returned: 0 in 0.804s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8b5dbdd0-17c0-4fa7-9649-c2acb64844c2 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bee28402-e59c-480a-8aad-a82f3df653a7 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:43 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bee28402-e59c-480a-8aad-a82f3df653a7 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01 Jul 04 00:11:43 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:44 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8b5dbdd0-17c0-4fa7-9649-c2acb64844c2 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bee28402-e59c-480a-8aad-a82f3df653a7 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01" returned: 0 in 0.662s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:44 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-8b5dbdd0-17c0-4fa7-9649-c2acb64844c2 tempest-CreateVolumesFromSnapshotTest-1884125868 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01 is being set with open permissions: ugo+rw Jul 04 00:11:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8b5dbdd0-17c0-4fa7-9649-c2acb64844c2 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:44 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01 Jul 04 00:11:44 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:44 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8b5dbdd0-17c0-4fa7-9649-c2acb64844c2 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01" returned: 0 in 0.649s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8b5dbdd0-17c0-4fa7-9649-c2acb64844c2 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:44 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.info Jul 04 00:11:44 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:45 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8b5dbdd0-17c0-4fa7-9649-c2acb64844c2 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.info" returned: 0 in 0.624s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:45 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-8b5dbdd0-17c0-4fa7-9649-c2acb64844c2 tempest-CreateVolumesFromSnapshotTest-1884125868 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.info is being set with open permissions: ugo+rw Jul 04 00:11:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8b5dbdd0-17c0-4fa7-9649-c2acb64844c2 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:45 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.info Jul 04 00:11:45 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:46 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8b5dbdd0-17c0-4fa7-9649-c2acb64844c2 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.info" returned: 0 in 0.616s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8b5dbdd0-17c0-4fa7-9649-c2acb64844c2 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.208s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:11:46 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8b5dbdd0-17c0-4fa7-9649-c2acb64844c2 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Create snapshot completed successfully Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Flow 'volume_create_manager' (afef5339-29c4-484a-b24a-88b90285a46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7019bf1-4b4f-44d2-af40-e69034aa42a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7019bf1-4b4f-44d2-af40-e69034aa42a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-890003988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5fd965-06e5-4eba-af0d-f52b27373336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099c70afca7d4f509d1367d87b9937f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:48Z,use_quota=True,user_id='5d40d22970da4445ad775cd76cadcbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2924bce-bb97-4a7d-802a-2294a4c972bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2924bce-bb97-4a7d-802a-2294a4c972bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b43f7f0-4840-4b46-8d1c-a489c06f8dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b43f7f0-4840-4b46-8d1c-a489c06f8dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff5fd965-06e5-4eba-af0d-f52b27373336', 'volume_name': 'volume-ff5fd965-06e5-4eba-af0d-f52b27373336', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a5835d-b381-4322-9f9e-20b2e937703d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a5835d-b381-4322-9f9e-20b2e937703d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a2ba18-e0b4-469f-b779-312495ac1891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:47 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Volume ff5fd965-06e5-4eba-af0d-f52b27373336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff5fd965-06e5-4eba-af0d-f52b27373336', 'volume_size': 1} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-890003988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5fd965-06e5-4eba-af0d-f52b27373336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099c70afca7d4f509d1367d87b9937f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:48Z,use_quota=True,user_id='5d40d22970da4445ad775cd76cadcbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Creating volume ff5fd965-06e5-4eba-af0d-f52b27373336 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:11:47 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:11:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ff5fd965-06e5-4eba-af0d-f52b27373336 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:47 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ff5fd965-06e5-4eba-af0d-f52b27373336 1073741824 Jul 04 00:11:47 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Flow 'volume_create_manager' (259d57b6-efac-4b5a-aa77-bffb14ba8b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (345cb6f3-8fa7-4542-a690-b50e0f8753dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (345cb6f3-8fa7-4542-a690-b50e0f8753dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-337101389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a51b9f-5686-45ed-b472-c980b5979786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099c70afca7d4f509d1367d87b9937f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:48Z,use_quota=True,user_id='5d40d22970da4445ad775cd76cadcbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccccf28f-00bc-47b6-acb5-e3fdb68dec0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccccf28f-00bc-47b6-acb5-e3fdb68dec0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8e6a47-aef7-4fd6-9aee-492c9db281fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8e6a47-aef7-4fd6-9aee-492c9db281fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30a51b9f-5686-45ed-b472-c980b5979786', 'volume_name': 'volume-30a51b9f-5686-45ed-b472-c980b5979786', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e5e37b-3703-4aba-9c5f-089d490ae97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e5e37b-3703-4aba-9c5f-089d490ae97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (293fec05-a809-48a4-8ee7-40f8da707f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:48 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Volume 30a51b9f-5686-45ed-b472-c980b5979786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30a51b9f-5686-45ed-b472-c980b5979786', 'volume_size': 1} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Flow 'volume_create_manager' (ae55a7f0-e99b-432c-9acc-0e88f8c7eccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442ddccb-d1a6-4ce6-8a39-fb923cc5b79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442ddccb-d1a6-4ce6-8a39-fb923cc5b79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-909063800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099c70afca7d4f509d1367d87b9937f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:48Z,use_quota=True,user_id='5d40d22970da4445ad775cd76cadcbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58eaaf1b-2c44-4a61-bdb7-ef42a3f7f2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58eaaf1b-2c44-4a61-bdb7-ef42a3f7f2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55d4b73-45f4-44c2-8fbe-639161a499b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55d4b73-45f4-44c2-8fbe-639161a499b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5', 'volume_name': 'volume-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34aeafde-02b4-4773-996c-7ce5a8f4018e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34aeafde-02b4-4773-996c-7ce5a8f4018e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32bdd8b-d7f9-4f0c-957b-9ff91ba3e969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:48 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Volume 12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5', 'volume_size': 1} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:11:48 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ff5fd965-06e5-4eba-af0d-f52b27373336 1073741824" returned: 0 in 0.976s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ff5fd965-06e5-4eba-af0d-f52b27373336 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:48 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ff5fd965-06e5-4eba-af0d-f52b27373336 Jul 04 00:11:48 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Flow 'volume_create_manager' (423a97bb-01d4-4c06-aa4d-b30d32d3a968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4076e5-f86c-4aec-8392-1b1956f44308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4076e5-f86c-4aec-8392-1b1956f44308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2064974500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c1f57d-915e-4488-b38c-d854d2c3802a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099c70afca7d4f509d1367d87b9937f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:49Z,use_quota=True,user_id='5d40d22970da4445ad775cd76cadcbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f075b9ff-9292-4de6-9e05-244fda89b271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f075b9ff-9292-4de6-9e05-244fda89b271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622fb121-28cf-4a8e-83a7-f5e6750e2eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622fb121-28cf-4a8e-83a7-f5e6750e2eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5c1f57d-915e-4488-b38c-d854d2c3802a', 'volume_name': 'volume-d5c1f57d-915e-4488-b38c-d854d2c3802a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807bcaba-82d4-4dc7-8378-8941478073ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807bcaba-82d4-4dc7-8378-8941478073ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6cab78-a94f-4312-a86c-2e4dd7d9e5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:48 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Volume d5c1f57d-915e-4488-b38c-d854d2c3802a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5c1f57d-915e-4488-b38c-d854d2c3802a', 'volume_size': 1} Jul 04 00:11:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Flow 'volume_create_manager' (927fdd43-4045-4170-ab02-f49d89baa7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26689b39-9064-4b64-994f-364ec86e3221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26689b39-9064-4b64-994f-364ec86e3221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-371010506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1459e274-6964-43c6-986a-872fa5479300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099c70afca7d4f509d1367d87b9937f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:49Z,use_quota=True,user_id='5d40d22970da4445ad775cd76cadcbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b7e4c4-da24-4b71-a80a-b58fdb1dd283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b7e4c4-da24-4b71-a80a-b58fdb1dd283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8620a90b-9ff5-41b6-8faf-3dd78ecda101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8620a90b-9ff5-41b6-8faf-3dd78ecda101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1459e274-6964-43c6-986a-872fa5479300', 'volume_name': 'volume-1459e274-6964-43c6-986a-872fa5479300', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16b5d72-c168-46ac-bef7-5e5d5c80c73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16b5d72-c168-46ac-bef7-5e5d5c80c73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0460e0b-513d-4140-877a-d1fad8e5dc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:49 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Volume 1459e274-6964-43c6-986a-872fa5479300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1459e274-6964-43c6-986a-872fa5479300', 'volume_size': 1} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:11:49 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ff5fd965-06e5-4eba-af0d-f52b27373336" returned: 0 in 0.683s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.282s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-337101389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a51b9f-5686-45ed-b472-c980b5979786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099c70afca7d4f509d1367d87b9937f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:48Z,use_quota=True,user_id='5d40d22970da4445ad775cd76cadcbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Creating volume 30a51b9f-5686-45ed-b472-c980b5979786 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:11:49 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a51b9f-5686-45ed-b472-c980b5979786 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a2ba18-e0b4-469f-b779-312495ac1891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff5fd965-06e5-4eba-af0d-f52b27373336', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:49 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a51b9f-5686-45ed-b472-c980b5979786 1073741824 Jul 04 00:11:49 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077eeeaa-c90d-4839-9566-2fc1daef8d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:49 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Volume volume-ff5fd965-06e5-4eba-af0d-f52b27373336 (ff5fd965-06e5-4eba-af0d-f52b27373336): created successfully Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077eeeaa-c90d-4839-9566-2fc1daef8d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Flow 'volume_create_manager' (afef5339-29c4-484a-b24a-88b90285a46f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:11:49 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d8582519-1363-455a-b424-fc3cc006ab4d tempest-CreateVolumesFromSnapshotTest-1884125868 None] Created volume successfully. Jul 04 00:11:50 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a51b9f-5686-45ed-b472-c980b5979786 1073741824" returned: 0 in 0.811s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a51b9f-5686-45ed-b472-c980b5979786 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:50 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a51b9f-5686-45ed-b472-c980b5979786 Jul 04 00:11:50 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:50 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a51b9f-5686-45ed-b472-c980b5979786" returned: 0 in 0.611s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:11:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:11:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.399s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:11:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-909063800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099c70afca7d4f509d1367d87b9937f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:48Z,use_quota=True,user_id='5d40d22970da4445ad775cd76cadcbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:11:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Creating volume 12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:11:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:11:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:11:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:11:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:11:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:11:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:11:50 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:11:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:50 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5 1073741824 Jul 04 00:11:50 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (293fec05-a809-48a4-8ee7-40f8da707f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30a51b9f-5686-45ed-b472-c980b5979786', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64cf2567-9a73-4107-b08e-0a58a1f91f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:50 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Volume volume-30a51b9f-5686-45ed-b472-c980b5979786 (30a51b9f-5686-45ed-b472-c980b5979786): created successfully Jul 04 00:11:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64cf2567-9a73-4107-b08e-0a58a1f91f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Flow 'volume_create_manager' (259d57b6-efac-4b5a-aa77-bffb14ba8b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:11:51 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1c134016-323f-43db-beec-3df53eb302ff tempest-CreateVolumesFromSnapshotTest-1884125868 None] Created volume successfully. Jul 04 00:11:51 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5 1073741824" returned: 0 in 0.834s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:51 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5 Jul 04 00:11:51 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:52 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5" returned: 0 in 0.639s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:11:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:11:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.515s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:11:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2064974500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c1f57d-915e-4488-b38c-d854d2c3802a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099c70afca7d4f509d1367d87b9937f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:49Z,use_quota=True,user_id='5d40d22970da4445ad775cd76cadcbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:11:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Creating volume d5c1f57d-915e-4488-b38c-d854d2c3802a {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:11:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:11:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:11:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:11:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:11:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:11:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:11:52 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:11:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d5c1f57d-915e-4488-b38c-d854d2c3802a 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32bdd8b-d7f9-4f0c-957b-9ff91ba3e969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:52 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d5c1f57d-915e-4488-b38c-d854d2c3802a 1073741824 Jul 04 00:11:52 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728acf40-51af-43b5-8324-d51d79e46b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:52 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Volume volume-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5 (12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5): created successfully Jul 04 00:11:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728acf40-51af-43b5-8324-d51d79e46b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Flow 'volume_create_manager' (ae55a7f0-e99b-432c-9acc-0e88f8c7eccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:11:52 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-993619c6-cffc-4b20-99bb-10227f111c33 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Created volume successfully. Jul 04 00:11:53 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d5c1f57d-915e-4488-b38c-d854d2c3802a 1073741824" returned: 0 in 0.839s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d5c1f57d-915e-4488-b38c-d854d2c3802a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:53 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d5c1f57d-915e-4488-b38c-d854d2c3802a Jul 04 00:11:53 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:53 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d5c1f57d-915e-4488-b38c-d854d2c3802a" returned: 0 in 0.643s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:11:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:11:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.686s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:11:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-371010506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1459e274-6964-43c6-986a-872fa5479300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099c70afca7d4f509d1367d87b9937f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:49Z,use_quota=True,user_id='5d40d22970da4445ad775cd76cadcbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:11:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Creating volume 1459e274-6964-43c6-986a-872fa5479300 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:11:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:11:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:11:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:11:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:11:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:11:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:11:53 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:11:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1459e274-6964-43c6-986a-872fa5479300 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:54 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1459e274-6964-43c6-986a-872fa5479300 1073741824 Jul 04 00:11:54 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6cab78-a94f-4312-a86c-2e4dd7d9e5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5c1f57d-915e-4488-b38c-d854d2c3802a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11bd984a-7a1a-4968-958b-b440e39fb64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:54 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Volume volume-d5c1f57d-915e-4488-b38c-d854d2c3802a (d5c1f57d-915e-4488-b38c-d854d2c3802a): created successfully Jul 04 00:11:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11bd984a-7a1a-4968-958b-b440e39fb64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Flow 'volume_create_manager' (423a97bb-01d4-4c06-aa4d-b30d32d3a968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:11:54 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2a2a3516-e7e2-4b2d-8120-df03a2ec6f88 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Created volume successfully. Jul 04 00:11:54 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1459e274-6964-43c6-986a-872fa5479300 1073741824" returned: 0 in 0.819s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1459e274-6964-43c6-986a-872fa5479300 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:54 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1459e274-6964-43c6-986a-872fa5479300 Jul 04 00:11:54 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:55 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1459e274-6964-43c6-986a-872fa5479300" returned: 0 in 0.633s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:11:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:11:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0460e0b-513d-4140-877a-d1fad8e5dc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1459e274-6964-43c6-986a-872fa5479300', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ce9f52-621b-49ad-a5fd-b51d06130e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:11:55 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Volume volume-1459e274-6964-43c6-986a-872fa5479300 (1459e274-6964-43c6-986a-872fa5479300): created successfully Jul 04 00:11:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ce9f52-621b-49ad-a5fd-b51d06130e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:11:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Flow 'volume_create_manager' (927fdd43-4045-4170-ab02-f49d89baa7cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:11:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e9097631-0720-484e-8421-6690237dcc53 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Created volume successfully. Jul 04 00:11:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "cinder-1459e274-6964-43c6-986a-872fa5479300-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:11:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-1459e274-6964-43c6-986a-872fa5479300-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:11:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "cinder-quobyte-1459e274-6964-43c6-986a-872fa5479300" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:11:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-quobyte-1459e274-6964-43c6-986a-872fa5479300" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:11:55 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d34861-a029-4956-b419-d2c1dc5278c0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:11:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1459e274-6964-43c6-986a-872fa5479300 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:55 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1459e274-6964-43c6-986a-872fa5479300 Jul 04 00:11:55 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:56 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1459e274-6964-43c6-986a-872fa5479300" returned: 0 in 0.783s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1459e274-6964-43c6-986a-872fa5479300 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:56 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1459e274-6964-43c6-986a-872fa5479300 Jul 04 00:11:56 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:57 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-1459e274-6964-43c6-986a-872fa5479300" returned: 0 in 0.672s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-quobyte-1459e274-6964-43c6-986a-872fa5479300" released by "delete_volume" :: held 1.493s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:11:57 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Created reservations ['61be8892-4674-4110-85e7-9abc4cd59725', '338f896a-c8c3-45c2-bf14-be70fd732846', '877b0cfe-ddf6-4ca5-8ccb-d339de9b660c', 'ca226596-30d3-4828-a45f-44e0579ca6c0'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:11:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:11:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:11:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:11:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:11:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:11:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:57 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:11:57 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "cinder-d5c1f57d-915e-4488-b38c-d854d2c3802a-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:11:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-d5c1f57d-915e-4488-b38c-d854d2c3802a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:11:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "cinder-quobyte-d5c1f57d-915e-4488-b38c-d854d2c3802a" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:11:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-quobyte-d5c1f57d-915e-4488-b38c-d854d2c3802a" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:11:58 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.650s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:58 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:11:58 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Deleted volume successfully. Jul 04 00:11:58 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7489591e-f6f6-469e-ba99-b9e84b159580]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:11:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d5c1f57d-915e-4488-b38c-d854d2c3802a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d6c21078-8fb2-4a42-8be6-385589ac5c95 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-1459e274-6964-43c6-986a-872fa5479300-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:11:58 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d5c1f57d-915e-4488-b38c-d854d2c3802a Jul 04 00:11:58 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:58 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d5c1f57d-915e-4488-b38c-d854d2c3802a" returned: 0 in 0.731s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d5c1f57d-915e-4488-b38c-d854d2c3802a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:58 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d5c1f57d-915e-4488-b38c-d854d2c3802a Jul 04 00:11:58 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:11:59 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jul 04 00:11:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d5c1f57d-915e-4488-b38c-d854d2c3802a" returned: 0 in 0.625s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:11:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-quobyte-d5c1f57d-915e-4488-b38c-d854d2c3802a" released by "delete_volume" :: held 1.396s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:11:59 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] Created reservations ['0b925e8c-b082-4859-b89a-37974865de90', '75cc1fe4-b1ac-47a1-842f-1c090db81015', '5fad71aa-fd8e-4faa-aa9e-da4e2ebe3cdc', '9221a36a-8601-410c-a18b-e42c3aeed899'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:11:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:11:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:11:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:11:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:11:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:11:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:11:59 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:11:59 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "cinder-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:00 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.648s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:00 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:12:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] Deleted volume successfully. Jul 04 00:12:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5583f3db-c454-49e8-a230-8748571562fc tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-d5c1f57d-915e-4488-b38c-d854d2c3802a-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "cinder-quobyte-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-quobyte-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5" acquired by "delete_volume" :: waited 0.012s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:00 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ff95bd-e05c-40d7-bbe7-3ca62932492b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:12:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:00 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5 Jul 04 00:12:00 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:01 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5" returned: 0 in 0.731s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:01 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5 Jul 04 00:12:01 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:01 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5" returned: 0 in 0.614s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-quobyte-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5" released by "delete_volume" :: held 1.381s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:01 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Created reservations ['60c31ce9-dee4-4d8f-8ec2-33a88bf6ed2a', 'ccc74fd0-55f0-4d6f-8386-e56b104a797b', '2f5d702d-62a1-46eb-8531-c10af3fcc0a0', '33e402c7-6f05-42ee-9c7d-957e64282047'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:12:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:01 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:12:01 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:02 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.606s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:02 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:12:02 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Deleted volume successfully. Jul 04 00:12:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a02ace17-bc73-4874-82f9-b7787a9c3a42 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-12e7ddeb-dfd2-4db3-9402-fe6ee0fb84e5-delete_volume" released by "delete_volume" :: held 2.188s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "cinder-30a51b9f-5686-45ed-b472-c980b5979786-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-30a51b9f-5686-45ed-b472-c980b5979786-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "cinder-quobyte-30a51b9f-5686-45ed-b472-c980b5979786" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-quobyte-30a51b9f-5686-45ed-b472-c980b5979786" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:02 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a942a644-f192-4f55-bfa1-1b1b49f6b66d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:12:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a51b9f-5686-45ed-b472-c980b5979786 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:02 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a51b9f-5686-45ed-b472-c980b5979786 Jul 04 00:12:02 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:03 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a51b9f-5686-45ed-b472-c980b5979786" returned: 0 in 0.720s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a51b9f-5686-45ed-b472-c980b5979786 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:03 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a51b9f-5686-45ed-b472-c980b5979786 Jul 04 00:12:03 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:03 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30a51b9f-5686-45ed-b472-c980b5979786" returned: 0 in 0.610s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-quobyte-30a51b9f-5686-45ed-b472-c980b5979786" released by "delete_volume" :: held 1.365s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:03 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Created reservations ['660b07da-c363-4354-8b2a-64d35b27e912', 'f3449346-c135-420a-b388-2d6b90370a58', '0ecaf0e5-f1ce-41d6-b7a1-5f0dfaad046d', 'b36ef275-0739-4e38-a5e5-db93f39800c1'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:12:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:04 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:12:04 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:04 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.613s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:04 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:12:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Deleted volume successfully. Jul 04 00:12:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f2d26731-cbc2-46a1-b745-4c45543b6539 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-30a51b9f-5686-45ed-b472-c980b5979786-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "cinder-ff5fd965-06e5-4eba-af0d-f52b27373336-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-ff5fd965-06e5-4eba-af0d-f52b27373336-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "cinder-quobyte-ff5fd965-06e5-4eba-af0d-f52b27373336" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-quobyte-ff5fd965-06e5-4eba-af0d-f52b27373336" acquired by "delete_volume" :: waited 0.013s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:04 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12212ff-0150-4749-a818-2c189e497c0b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:12:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ff5fd965-06e5-4eba-af0d-f52b27373336 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:04 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ff5fd965-06e5-4eba-af0d-f52b27373336 Jul 04 00:12:04 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:05 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ff5fd965-06e5-4eba-af0d-f52b27373336" returned: 0 in 0.729s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ff5fd965-06e5-4eba-af0d-f52b27373336 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:05 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ff5fd965-06e5-4eba-af0d-f52b27373336 Jul 04 00:12:05 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:06 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-ff5fd965-06e5-4eba-af0d-f52b27373336" returned: 0 in 0.708s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-quobyte-ff5fd965-06e5-4eba-af0d-f52b27373336" released by "delete_volume" :: held 1.477s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:06 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Created reservations ['eaba5d59-d04a-466d-8fe1-93c4264657bc', 'f3d8c2db-535e-4597-a690-81078f83a05d', 'b7539570-9bee-4874-8c1b-31aacc54c19b', 'ca1dc3e8-5d01-40e5-a57c-223456f4ebf5'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:12:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:06 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:12:06 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "cinder-ca515896-868d-44c0-8775-9e5e26e0cc01-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-ca515896-868d-44c0-8775-9e5e26e0cc01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "cinder-quobyte-bee28402-e59c-480a-8aad-a82f3df653a7" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-quobyte-bee28402-e59c-480a-8aad-a82f3df653a7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "cinder-quobyte-ca515896-868d-44c0-8775-9e5e26e0cc01" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-quobyte-ca515896-868d-44c0-8775-9e5e26e0cc01" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Deleting offline snapshot ca515896-868d-44c0-8775-9e5e26e0cc01 of volume bee28402-e59c-480a-8aad-a82f3df653a7 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:12:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] snapshot_file for this snap is: volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:12:06 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4514d55-207f-4a38-9c66-227ba198613d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:12:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:07 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.670s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:07 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:12:07 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Deleted volume successfully. Jul 04 00:12:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9fe5cf93-15de-4d18-ac42-2c2091746173 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-ff5fd965-06e5-4eba-af0d-f52b27373336-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:07 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01 Jul 04 00:12:07 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:07 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01" returned: 0 in 0.835s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bee28402-e59c-480a-8aad-a82f3df653a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:12:07 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6041f7d-82ef-44a6-b82b-530258aa4b1f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:12:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:07 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7 Jul 04 00:12:07 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:08 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7" returned: 0 in 0.756s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:08 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01 Jul 04 00:12:08 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:09 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01" returned: 0 in 0.728s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:09 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01 Jul 04 00:12:09 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:09 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7.ca515896-868d-44c0-8775-9e5e26e0cc01" returned: 0 in 0.631s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-quobyte-ca515896-868d-44c0-8775-9e5e26e0cc01" released by "_delete_snapshot" :: held 3.059s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-quobyte-bee28402-e59c-480a-8aad-a82f3df653a7" released by "delete_snapshot" :: held 3.087s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:10 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Created reservations ['7f7bedb0-555e-4334-880f-d919dd897c09', 'e12e0336-9c0d-43a5-9311-856e7d5cbaee', 'd6e5f3ed-7658-4d0b-be3d-facfe55df77a', 'a867ad77-8dfb-4b00-915c-782e4799d7df'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:12:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Delete snapshot completed successfully. Jul 04 00:12:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c8d3d8e3-d25d-4214-b2c4-a36047bdaeb3 tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-ca515896-868d-44c0-8775-9e5e26e0cc01-delete_snapshot" released by "delete_snapshot" :: held 3.236s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "cinder-bee28402-e59c-480a-8aad-a82f3df653a7-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-bee28402-e59c-480a-8aad-a82f3df653a7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "cinder-quobyte-bee28402-e59c-480a-8aad-a82f3df653a7" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-quobyte-bee28402-e59c-480a-8aad-a82f3df653a7" acquired by "delete_volume" :: waited 0.013s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:11 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8567027-ffc8-471d-a068-515f4b9bfc08]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:12:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:11 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7 Jul 04 00:12:11 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:11 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7" returned: 0 in 0.712s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:11 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7 Jul 04 00:12:11 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:12 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-bee28402-e59c-480a-8aad-a82f3df653a7" returned: 0 in 0.607s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-quobyte-bee28402-e59c-480a-8aad-a82f3df653a7" released by "delete_volume" :: held 1.374s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:12 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] Created reservations ['301dd1f8-a1e9-47ca-8c3f-fb8f56593245', '8f865206-808b-44fa-8741-d34ef055745a', '61410112-64af-4bd6-8c96-0ca01c7cbf77', '92bb63ba-3d88-4a27-bf32-c4bc697d68a3'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:12:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:12 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:12:12 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:13 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.675s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:13 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:12:13 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] Deleted volume successfully. Jul 04 00:12:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2e1261e-781f-4898-bb6b-3bfe5130ca5e tempest-CreateVolumesFromSnapshotTest-1884125868 None] Lock "cinder-bee28402-e59c-480a-8aad-a82f3df653a7-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:22 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=71,cinder:SELECT=46,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:12:23 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=56,cinder:UPDATE=75,cinder:INSERT=21,cinder:DELETE=8 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Flow 'volume_create_manager' (78d9a861-ebcf-4401-98a9-4c93b8415b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30018f6-4fcd-4911-ab8f-3a6462510598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30018f6-4fcd-4911-ab8f-3a6462510598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-246818634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8076011-49f6-479e-accd-b0f9b4826051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9fb51fa750b42acbac8a84b449f7e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:30Z,use_quota=True,user_id='f74834e7a32a4ae1b8f01237bbe1a7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc5c3f0-fdd1-4969-9fbd-0680254f9701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc5c3f0-fdd1-4969-9fbd-0680254f9701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f52a4a-a32a-4f58-adfb-dfda39ff774b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f52a4a-a32a-4f58-adfb-dfda39ff774b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8076011-49f6-479e-accd-b0f9b4826051', 'volume_name': 'volume-b8076011-49f6-479e-accd-b0f9b4826051', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d8e7b1a-3f0f-43af-8b7e-e1b0e9442a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d8e7b1a-3f0f-43af-8b7e-e1b0e9442a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9953c456-fc34-4cae-bdba-46cb604dec91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:30 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Volume b8076011-49f6-479e-accd-b0f9b4826051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8076011-49f6-479e-accd-b0f9b4826051', 'volume_size': 1} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-246818634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8076011-49f6-479e-accd-b0f9b4826051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9fb51fa750b42acbac8a84b449f7e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:30Z,use_quota=True,user_id='f74834e7a32a4ae1b8f01237bbe1a7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Creating volume b8076011-49f6-479e-accd-b0f9b4826051 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:12:30 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:12:30 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051 1073741824 Jul 04 00:12:30 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Flow 'volume_create_manager' (33a2017d-cae0-4d88-b884-7c5cb89c77f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4903024a-c368-4bd1-b08b-0f2cd35a5eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4903024a-c368-4bd1-b08b-0f2cd35a5eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-745512165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a404d2-e347-468b-887f-1daac64c4971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3ad7e13def4406b4e4cd5c98ef6187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:30Z,use_quota=True,user_id='ae5c3746ba89415faf2edd85238ca881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e956b4ca-f202-4513-b29a-cd0159cda5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e956b4ca-f202-4513-b29a-cd0159cda5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0274f0c3-de9d-44b3-8c96-53d8bd6f3908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0274f0c3-de9d-44b3-8c96-53d8bd6f3908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4a404d2-e347-468b-887f-1daac64c4971', 'volume_name': 'volume-b4a404d2-e347-468b-887f-1daac64c4971', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62962d8-02ad-4c5c-a047-b385b40cc61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62962d8-02ad-4c5c-a047-b385b40cc61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c8409e-e5ac-477f-a644-420bfc4dd14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:30 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Volume b4a404d2-e347-468b-887f-1daac64c4971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4a404d2-e347-468b-887f-1daac64c4971', 'volume_size': 1} Jul 04 00:12:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Flow 'volume_create_manager' (e9648136-bc51-47b4-afc3-883bf564e864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3acd57-ce51-4795-a2f7-e7df0b40292e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3acd57-ce51-4795-a2f7-e7df0b40292e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-976313680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02921c6a-67e3-438a-820d-19b735e4a6f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01eee48f4d584b07a8915d09883f08c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:31Z,use_quota=True,user_id='c660e44ac7494218aa4c436ee8a32527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ed4a8b-1f56-4794-b586-ed70d16b474d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ed4a8b-1f56-4794-b586-ed70d16b474d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5818e885-e6c0-4b9a-9fb6-9e11d773ac23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5818e885-e6c0-4b9a-9fb6-9e11d773ac23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02921c6a-67e3-438a-820d-19b735e4a6f6', 'volume_name': 'volume-02921c6a-67e3-438a-820d-19b735e4a6f6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f18c4cdf-2642-48da-bf96-224e24f1f22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f18c4cdf-2642-48da-bf96-224e24f1f22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f2cb25-181c-4e84-b1c4-c940254d9acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:31 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Volume 02921c6a-67e3-438a-820d-19b735e4a6f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02921c6a-67e3-438a-820d-19b735e4a6f6', 'volume_size': 1} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Flow 'volume_create_manager' (64d61172-77d4-4a83-ac60-66de5c0f8df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5792bddf-c4dd-43e0-af70-25f8baa59590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5792bddf-c4dd-43e0-af70-25f8baa59590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1428112366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6ea5313-b5ad-4749-9d4d-d12e660611e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01eee48f4d584b07a8915d09883f08c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:32Z,use_quota=True,user_id='c660e44ac7494218aa4c436ee8a32527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c979fc-c880-4597-a9d9-31141a757bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c979fc-c880-4597-a9d9-31141a757bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad050d5f-75b8-4106-ba0f-31751f407d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad050d5f-75b8-4106-ba0f-31751f407d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6ea5313-b5ad-4749-9d4d-d12e660611e9', 'volume_name': 'volume-d6ea5313-b5ad-4749-9d4d-d12e660611e9', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5319df52-5a8e-4000-ab9e-efb3ad3cd179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5319df52-5a8e-4000-ab9e-efb3ad3cd179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb477eb-08a2-4597-8a67-63654a8e1ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:31 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Volume d6ea5313-b5ad-4749-9d4d-d12e660611e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6ea5313-b5ad-4749-9d4d-d12e660611e9', 'volume_size': 1} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:31 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051 1073741824" returned: 0 in 1.191s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:31 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051 Jul 04 00:12:31 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Flow 'volume_create_manager' (b1c828a1-0d91-4c62-ae1e-477a7ea29919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a9b941-bc6d-4618-a534-34cd221bb857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a9b941-bc6d-4618-a534-34cd221bb857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-968505162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01eee48f4d584b07a8915d09883f08c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:32Z,use_quota=True,user_id='c660e44ac7494218aa4c436ee8a32527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0839c8ac-1da1-4ea6-bec6-be1b0a4c3c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0839c8ac-1da1-4ea6-bec6-be1b0a4c3c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81bec50a-f2a0-47c5-ad5b-0e46807b6d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81bec50a-f2a0-47c5-ad5b-0e46807b6d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8', 'volume_name': 'volume-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b7335e-9bcb-40cd-8dba-60fab56ea99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b7335e-9bcb-40cd-8dba-60fab56ea99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63888cfd-d58d-467f-b849-a5d098854bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:32 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Volume f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8', 'volume_size': 1} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Flow 'volume_create_manager' (c609b759-b6e0-4e69-922e-a682d9171035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0048411f-6bf4-4737-a956-30ce04050d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0048411f-6bf4-4737-a956-30ce04050d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-101385944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10cfaf5e-32d3-4d94-aea0-21abac422485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01eee48f4d584b07a8915d09883f08c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:32Z,use_quota=True,user_id='c660e44ac7494218aa4c436ee8a32527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392fd380-a486-435f-a915-c3b780ba7e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392fd380-a486-435f-a915-c3b780ba7e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77777592-4b46-4290-841e-4e297312ebad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77777592-4b46-4290-841e-4e297312ebad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10cfaf5e-32d3-4d94-aea0-21abac422485', 'volume_name': 'volume-10cfaf5e-32d3-4d94-aea0-21abac422485', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035c80bc-5722-488e-9ee7-4c4810d52e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035c80bc-5722-488e-9ee7-4c4810d52e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b3d666-364e-40c9-b319-15e4351c5f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:32 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Volume 10cfaf5e-32d3-4d94-aea0-21abac422485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10cfaf5e-32d3-4d94-aea0-21abac422485', 'volume_size': 1} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:32 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051" returned: 0 in 0.987s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] <== create_volume: return (2220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.223s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.093s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-745512165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a404d2-e347-468b-887f-1daac64c4971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3ad7e13def4406b4e4cd5c98ef6187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:30Z,use_quota=True,user_id='ae5c3746ba89415faf2edd85238ca881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Creating volume b4a404d2-e347-468b-887f-1daac64c4971 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:12:32 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b4a404d2-e347-468b-887f-1daac64c4971 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:32 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b4a404d2-e347-468b-887f-1daac64c4971 1073741824 Jul 04 00:12:32 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9953c456-fc34-4cae-bdba-46cb604dec91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8076011-49f6-479e-accd-b0f9b4826051', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e93637c-542d-431d-96bf-4b3181d7d575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:32 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Volume volume-b8076011-49f6-479e-accd-b0f9b4826051 (b8076011-49f6-479e-accd-b0f9b4826051): created successfully Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e93637c-542d-431d-96bf-4b3181d7d575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Flow 'volume_create_manager' (78d9a861-ebcf-4401-98a9-4c93b8415b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:32 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e444c6a9-f073-4249-bece-314d7f8724c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Created volume successfully. Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Flow 'volume_create_manager' (de87ab34-6c20-4965-ada3-7ea009271693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302b0855-b7be-4cca-bc56-b2262e74cddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302b0855-b7be-4cca-bc56-b2262e74cddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-264491753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e20897-45f0-4cbe-b485-dbc78c83dfe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01eee48f4d584b07a8915d09883f08c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:33Z,use_quota=True,user_id='c660e44ac7494218aa4c436ee8a32527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ee5f55-48ee-42e1-823c-cf4aa29a597b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ee5f55-48ee-42e1-823c-cf4aa29a597b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20288b6e-4940-494c-afc5-70285e683c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20288b6e-4940-494c-afc5-70285e683c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06e20897-45f0-4cbe-b485-dbc78c83dfe4', 'volume_name': 'volume-06e20897-45f0-4cbe-b485-dbc78c83dfe4', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b40e185-e31c-40fe-9924-4d6dca7ace6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b40e185-e31c-40fe-9924-4d6dca7ace6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8595842e-01a3-45a2-8b85-733464b2f089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:33 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Volume 06e20897-45f0-4cbe-b485-dbc78c83dfe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06e20897-45f0-4cbe-b485-dbc78c83dfe4', 'volume_size': 1} Jul 04 00:12:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:12:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:33 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:12:33 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:33 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b4a404d2-e347-468b-887f-1daac64c4971 1073741824" returned: 0 in 1.001s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3814f663-4f40-4cf8-a2f6-fe5f41e6e2ce tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b4a404d2-e347-468b-887f-1daac64c4971 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:33 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b4a404d2-e347-468b-887f-1daac64c4971 Jul 04 00:12:33 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:34 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.854s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:12:34 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b4a404d2-e347-468b-887f-1daac64c4971" returned: 0 in 0.686s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.326s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-976313680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02921c6a-67e3-438a-820d-19b735e4a6f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01eee48f4d584b07a8915d09883f08c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:31Z,use_quota=True,user_id='c660e44ac7494218aa4c436ee8a32527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Creating volume 02921c6a-67e3-438a-820d-19b735e4a6f6 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:12:34 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-02921c6a-67e3-438a-820d-19b735e4a6f6 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:34 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-02921c6a-67e3-438a-820d-19b735e4a6f6 1073741824 Jul 04 00:12:34 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c8409e-e5ac-477f-a644-420bfc4dd14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4a404d2-e347-468b-887f-1daac64c4971', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6f78dd-5064-48d1-8fba-354741178250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:34 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Volume volume-b4a404d2-e347-468b-887f-1daac64c4971 (b4a404d2-e347-468b-887f-1daac64c4971): created successfully Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6f78dd-5064-48d1-8fba-354741178250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Flow 'volume_create_manager' (33a2017d-cae0-4d88-b884-7c5cb89c77f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:34 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a78a6c09-d773-4dd5-9442-c1f4f6fcf479 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Created volume successfully. Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Flow 'volume_create_manager' (6252ec4c-9563-49d8-9b3c-8bf21422864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beec3162-3e34-442e-a5b0-0d490adb954d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beec3162-3e34-442e-a5b0-0d490adb954d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acc387ab-4963-4222-bf8a-883c3f2ded88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b81c48a66b4958af789e51e5966839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:35Z,use_quota=True,user_id='01687a96e71d4977922f7500d3474ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f3e1739-6491-4d73-8040-7b569ac6d8c8),volume_type_id=9f3e1739-6491-4d73-8040-7b569ac6d8c8)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4263c622-e6db-489f-a9ba-dd084e0aefc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4263c622-e6db-489f-a9ba-dd084e0aefc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3450ba1-cae8-443b-a282-e4c9584be71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:34 devstack cinder-volume[86676]: DEBUG cinder.image.glance [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Creating Keystone auth plugin from conf {{(pid=86676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 04 00:12:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3450ba1-cae8-443b-a282-e4c9584be71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'acc387ab-4963-4222-bf8a-883c3f2ded88', 'volume_name': 'volume-acc387ab-4963-4222-bf8a-883c3f2ded88', 'volume_size': 1, 'image_id': '929f33cb-7da8-47b8-b5d1-bd8756eed958', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/929f33cb-7da8-47b8-b5d1-bd8756eed958', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fa23c002da7621078ebefb24b5412f81', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '10b81c48a66b4958af789e51e5966839', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ad4e265d80df9bb17e48c377dbe674829903e9035e216dc95779af0eb95ea02e915e2444c151e29a482f5d05b294a6222ed3aa5ba0f42b1d6dab450895eecb64', 'id': '929f33cb-7da8-47b8-b5d1-bd8756eed958', 'created_at': datetime.datetime(2026, 7, 3, 22, 12, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 12, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/929f33cb-7da8-47b8-b5d1-bd8756eed958/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7622829b-cc5a-487e-ac9a-a705507d0e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7622829b-cc5a-487e-ac9a-a705507d0e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e350979-845f-4055-9de7-dc649f0d51a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:35 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Volume acc387ab-4963-4222-bf8a-883c3f2ded88: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-acc387ab-4963-4222-bf8a-883c3f2ded88', 'volume_size': 1, 'image_id': '929f33cb-7da8-47b8-b5d1-bd8756eed958', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/929f33cb-7da8-47b8-b5d1-bd8756eed958', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fa23c002da7621078ebefb24b5412f81', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '10b81c48a66b4958af789e51e5966839', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ad4e265d80df9bb17e48c377dbe674829903e9035e216dc95779af0eb95ea02e915e2444c151e29a482f5d05b294a6222ed3aa5ba0f42b1d6dab450895eecb64', 'id': '929f33cb-7da8-47b8-b5d1-bd8756eed958', 'created_at': datetime.datetime(2026, 7, 3, 22, 12, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 12, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/929f33cb-7da8-47b8-b5d1-bd8756eed958/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 04 00:12:35 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Trying to clone acc387ab-4963-4222-bf8a-883c3f2ded88 from image 929f33cb-7da8-47b8-b5d1-bd8756eed958 at location (None, [{'url': 'file:///opt/stack/data/glance/images/929f33cb-7da8-47b8-b5d1-bd8756eed958', 'metadata': {}}]). {{(pid=86676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 04 00:12:35 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 04 00:12:35 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Image download 0.00 MB at 0.00 MB/s Jul 04 00:12:35 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7462dfa-8dad-47c5-b08d-75514e11142b]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:12:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:35 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-02921c6a-67e3-438a-820d-19b735e4a6f6 1073741824" returned: 0 in 0.919s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-02921c6a-67e3-438a-820d-19b735e4a6f6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:35 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-02921c6a-67e3-438a-820d-19b735e4a6f6 Jul 04 00:12:35 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:35 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD Jul 04 00:12:35 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:36 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD" returned: 0 in 0.786s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:36 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-02921c6a-67e3-438a-820d-19b735e4a6f6" returned: 0 in 0.736s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.576s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1428112366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6ea5313-b5ad-4749-9d4d-d12e660611e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01eee48f4d584b07a8915d09883f08c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:32Z,use_quota=True,user_id='c660e44ac7494218aa4c436ee8a32527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Creating volume d6ea5313-b5ad-4749-9d4d-d12e660611e9 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:12:36 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d6ea5313-b5ad-4749-9d4d-d12e660611e9 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:36 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD Jul 04 00:12:36 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:36 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d6ea5313-b5ad-4749-9d4d-d12e660611e9 1073741824 Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f2cb25-181c-4e84-b1c4-c940254d9acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02921c6a-67e3-438a-820d-19b735e4a6f6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:36 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3765d9e7-6c73-48c1-899f-cbd5701b6a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:36 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Volume volume-02921c6a-67e3-438a-820d-19b735e4a6f6 (02921c6a-67e3-438a-820d-19b735e4a6f6): created successfully Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3765d9e7-6c73-48c1-899f-cbd5701b6a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Flow 'volume_create_manager' (e9648136-bc51-47b4-afc3-883bf564e864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Flow 'volume_create_manager' (3717541a-ae44-4d40-9201-0997294cafcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5fcc589-d5d7-4079-8a1a-782c74db2a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:36 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-35f2527a-59f1-458d-acd5-58d7c21fc705 tempest-CreateVolumesFromImageTest-551164080 None] Created volume successfully. Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5fcc589-d5d7-4079-8a1a-782c74db2a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-769330640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2167ff84-6317-4b26-8e87-1a34497e5b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3ad7e13def4406b4e4cd5c98ef6187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:36Z,use_quota=True,user_id='ae5c3746ba89415faf2edd85238ca881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0320d843-d874-479f-b368-9e87e26ab572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0320d843-d874-479f-b368-9e87e26ab572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a324bbae-f607-43a8-bdc8-7ed8cde3e37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a324bbae-f607-43a8-bdc8-7ed8cde3e37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2167ff84-6317-4b26-8e87-1a34497e5b8e', 'volume_name': 'volume-2167ff84-6317-4b26-8e87-1a34497e5b8e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0751c35f-a8d9-4be8-8d0c-733f78a64232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0751c35f-a8d9-4be8-8d0c-733f78a64232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d44383c-f714-407d-a097-dd223a7218a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:36 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Volume 2167ff84-6317-4b26-8e87-1a34497e5b8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2167ff84-6317-4b26-8e87-1a34497e5b8e', 'volume_size': 1} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Flow 'volume_create_manager' (0a802183-ee9b-402f-a017-880075f68913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d293e3a2-e7ab-4e9e-b462-2b8d2cd316a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d293e3a2-e7ab-4e9e-b462-2b8d2cd316a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1322057191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6084ec-d6c0-408e-8c85-8c46fa07047d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3ad7e13def4406b4e4cd5c98ef6187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:37Z,use_quota=True,user_id='ae5c3746ba89415faf2edd85238ca881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8cb534-730e-4dae-9b36-c92482f5e314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8cb534-730e-4dae-9b36-c92482f5e314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b98665-7601-4f69-abaf-c30e21731a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b98665-7601-4f69-abaf-c30e21731a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf6084ec-d6c0-408e-8c85-8c46fa07047d', 'volume_name': 'volume-cf6084ec-d6c0-408e-8c85-8c46fa07047d', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac6360c-07f8-45a3-816f-be23bfda879e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac6360c-07f8-45a3-816f-be23bfda879e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8031599-a746-490f-a705-b3f7a0ae4176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:36 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Volume cf6084ec-d6c0-408e-8c85-8c46fa07047d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf6084ec-d6c0-408e-8c85-8c46fa07047d', 'volume_size': 1} Jul 04 00:12:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Flow 'volume_create_manager' (5ec22e55-6969-4023-8859-0f6ad35c6702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740cc491-1de5-4995-b34f-2d2627eed952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740cc491-1de5-4995-b34f-2d2627eed952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1836538939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ae0e71-c330-4914-b930-dbc9be016a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3ad7e13def4406b4e4cd5c98ef6187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:37Z,use_quota=True,user_id='ae5c3746ba89415faf2edd85238ca881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b8ead8-88ce-46f8-8571-4ffaf69aa208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b8ead8-88ce-46f8-8571-4ffaf69aa208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92f038d-6f19-47ca-9bf6-c582dd36475f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92f038d-6f19-47ca-9bf6-c582dd36475f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13ae0e71-c330-4914-b930-dbc9be016a36', 'volume_name': 'volume-13ae0e71-c330-4914-b930-dbc9be016a36', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:37 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6818cbc6-99c0-4beb-8db7-5cb865de8d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6818cbc6-99c0-4beb-8db7-5cb865de8d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc79299-1eb2-4594-b356-3d95eb103e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:37 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Volume 13ae0e71-c330-4914-b930-dbc9be016a36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13ae0e71-c330-4914-b930-dbc9be016a36', 'volume_size': 1} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD" returned: 1 in 1.130s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Temporary image 929f33cb-7da8-47b8-b5d1-bd8756eed958 is fetched for user 01687a96e71d4977922f7500d3474ea9. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d880b5-fec6-4a18-af5c-5ef4002fcb28]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:37 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d6ea5313-b5ad-4749-9d4d-d12e660611e9 1073741824" returned: 0 in 1.256s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:37 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD Jul 04 00:12:37 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d6ea5313-b5ad-4749-9d4d-d12e660611e9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:37 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d6ea5313-b5ad-4749-9d4d-d12e660611e9 Jul 04 00:12:37 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Flow 'volume_create_manager' (fd431ef2-efee-4069-bc34-52a74f97500d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4b9e5b-b0ba-40da-b1c3-3a5e02c2a0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4b9e5b-b0ba-40da-b1c3-3a5e02c2a0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660937538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e1312c-8e3c-4728-a985-9dfdb1276ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3ad7e13def4406b4e4cd5c98ef6187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:38Z,use_quota=True,user_id='ae5c3746ba89415faf2edd85238ca881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346a44bd-214b-4ba2-a881-d040f11131c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346a44bd-214b-4ba2-a881-d040f11131c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06339238-b371-45b6-ba76-9b650c8b9e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06339238-b371-45b6-ba76-9b650c8b9e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36e1312c-8e3c-4728-a985-9dfdb1276ce1', 'volume_name': 'volume-36e1312c-8e3c-4728-a985-9dfdb1276ce1', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ecf32d8-195f-441e-a2c2-d8e3656cd37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ecf32d8-195f-441e-a2c2-d8e3656cd37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b7bcc4-1952-4642-9060-e407796eac21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:37 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Volume 36e1312c-8e3c-4728-a985-9dfdb1276ce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36e1312c-8e3c-4728-a985-9dfdb1276ce1', 'volume_size': 1} Jul 04 00:12:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Flow 'volume_create_manager' (2a91ad95-4988-4cde-8253-b891a96c72ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf7fffd-2b0f-4958-b924-9d6f6c58e683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf7fffd-2b0f-4958-b924-9d6f6c58e683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-101671302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae721ff-ed28-48e6-9507-71727b147cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3ad7e13def4406b4e4cd5c98ef6187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:38Z,use_quota=True,user_id='ae5c3746ba89415faf2edd85238ca881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deac06c6-3138-4e99-a6f7-24ba5c4d1d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deac06c6-3138-4e99-a6f7-24ba5c4d1d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53e8d3b-1fd2-4113-84fc-096ddb940d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53e8d3b-1fd2-4113-84fc-096ddb940d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ae721ff-ed28-48e6-9507-71727b147cde', 'volume_name': 'volume-4ae721ff-ed28-48e6-9507-71727b147cde', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf69d62-e8f9-4d3b-acd7-deeb292d2651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf69d62-e8f9-4d3b-acd7-deeb292d2651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e075b1bc-9d79-4291-ae90-0bddd720752e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Volume 4ae721ff-ed28-48e6-9507-71727b147cde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ae721ff-ed28-48e6-9507-71727b147cde', 'volume_size': 1} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:38 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d6ea5313-b5ad-4749-9d4d-d12e660611e9" returned: 0 in 0.712s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.152s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-968505162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01eee48f4d584b07a8915d09883f08c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:32Z,use_quota=True,user_id='c660e44ac7494218aa4c436ee8a32527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Creating volume f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:12:38 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb477eb-08a2-4597-8a67-63654a8e1ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6ea5313-b5ad-4749-9d4d-d12e660611e9', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:38 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8 1073741824 Jul 04 00:12:38 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea312ee-f326-415e-939c-c3b2ceb7fcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:38 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD" returned: 0 in 0.938s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Volume volume-d6ea5313-b5ad-4749-9d4d-d12e660611e9 (d6ea5313-b5ad-4749-9d4d-d12e660611e9): created successfully Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea312ee-f326-415e-939c-c3b2ceb7fcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Flow 'volume_create_manager' (64d61172-77d4-4a83-ac60-66de5c0f8df6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0efbeda1-60eb-462f-b03c-29571d90bd1d tempest-CreateVolumesFromImageTest-551164080 None] Created volume successfully. Jul 04 00:12:38 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD Jul 04 00:12:38 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:39 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD" returned: 1 in 0.769s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:39 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8 1073741824" returned: 0 in 0.836s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:39 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8 Jul 04 00:12:39 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:39 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8" returned: 0 in 0.667s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.217s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-101385944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10cfaf5e-32d3-4d94-aea0-21abac422485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01eee48f4d584b07a8915d09883f08c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:32Z,use_quota=True,user_id='c660e44ac7494218aa4c436ee8a32527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Creating volume 10cfaf5e-32d3-4d94-aea0-21abac422485 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:12:39 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-10cfaf5e-32d3-4d94-aea0-21abac422485 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:39 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-10cfaf5e-32d3-4d94-aea0-21abac422485 1073741824 Jul 04 00:12:39 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63888cfd-d58d-467f-b849-a5d098854bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e9e61e1-30a8-4749-858c-ad6193ff6e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:39 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Volume volume-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8 (f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8): created successfully Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e9e61e1-30a8-4749-858c-ad6193ff6e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Flow 'volume_create_manager' (b1c828a1-0d91-4c62-ae1e-477a7ea29919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:39 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e257a019-fdea-43e1-b615-564c096d5f31 tempest-CreateVolumesFromImageTest-551164080 None] Created volume successfully. Jul 04 00:12:40 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-10cfaf5e-32d3-4d94-aea0-21abac422485 1073741824" returned: 0 in 0.829s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-10cfaf5e-32d3-4d94-aea0-21abac422485 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:40 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-10cfaf5e-32d3-4d94-aea0-21abac422485 Jul 04 00:12:40 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:41 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-10cfaf5e-32d3-4d94-aea0-21abac422485" returned: 0 in 0.645s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:12:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.320s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-264491753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e20897-45f0-4cbe-b485-dbc78c83dfe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01eee48f4d584b07a8915d09883f08c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:33Z,use_quota=True,user_id='c660e44ac7494218aa4c436ee8a32527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:12:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Creating volume 06e20897-45f0-4cbe-b485-dbc78c83dfe4 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:12:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:12:41 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:12:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-06e20897-45f0-4cbe-b485-dbc78c83dfe4 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b3d666-364e-40c9-b319-15e4351c5f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10cfaf5e-32d3-4d94-aea0-21abac422485', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:41 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-06e20897-45f0-4cbe-b485-dbc78c83dfe4 1073741824 Jul 04 00:12:41 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70a8bf6-630a-45e8-b454-888a62bdfb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:41 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Volume volume-10cfaf5e-32d3-4d94-aea0-21abac422485 (10cfaf5e-32d3-4d94-aea0-21abac422485): created successfully Jul 04 00:12:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70a8bf6-630a-45e8-b454-888a62bdfb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Flow 'volume_create_manager' (c609b759-b6e0-4e69-922e-a682d9171035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:41 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5aecf147-6da7-4960-92a4-8a951e7ecce3 tempest-CreateVolumesFromImageTest-551164080 None] Created volume successfully. Jul 04 00:12:42 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-06e20897-45f0-4cbe-b485-dbc78c83dfe4 1073741824" returned: 0 in 0.905s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-06e20897-45f0-4cbe-b485-dbc78c83dfe4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:42 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-06e20897-45f0-4cbe-b485-dbc78c83dfe4 Jul 04 00:12:42 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:42 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-06e20897-45f0-4cbe-b485-dbc78c83dfe4" returned: 0 in 0.636s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:12:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3814f663-4f40-4cf8-a2f6-fe5f41e6e2ce tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.135s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3814f663-4f40-4cf8-a2f6-fe5f41e6e2ce tempest-CreateVolumesFromSnapshotTest-456539927 None] Creating offline snapshot 4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed of volume b8076011-49f6-479e-accd-b0f9b4826051 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:12:42 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8875b0ab-8235-4283-8c46-18dc93819cdd]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:12:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3814f663-4f40-4cf8-a2f6-fe5f41e6e2ce tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8595842e-01a3-45a2-8b85-733464b2f089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06e20897-45f0-4cbe-b485-dbc78c83dfe4', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1f1a87-1c8f-4852-8c21-8617e62b306b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:43 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Volume volume-06e20897-45f0-4cbe-b485-dbc78c83dfe4 (06e20897-45f0-4cbe-b485-dbc78c83dfe4): created successfully Jul 04 00:12:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1f1a87-1c8f-4852-8c21-8617e62b306b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Flow 'volume_create_manager' (de87ab34-6c20-4965-ada3-7ea009271693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-339b4981-b074-4ac3-a6fd-7ad929b780e2 tempest-CreateVolumesFromImageTest-551164080 None] Created volume successfully. Jul 04 00:12:43 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051 Jul 04 00:12:43 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:43 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3814f663-4f40-4cf8-a2f6-fe5f41e6e2ce tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051" returned: 0 in 0.744s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3814f663-4f40-4cf8-a2f6-fe5f41e6e2ce tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:43 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed 1G Jul 04 00:12:43 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "cinder-06e20897-45f0-4cbe-b485-dbc78c83dfe4-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-06e20897-45f0-4cbe-b485-dbc78c83dfe4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "cinder-quobyte-06e20897-45f0-4cbe-b485-dbc78c83dfe4" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-quobyte-06e20897-45f0-4cbe-b485-dbc78c83dfe4" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:43 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[247fece4-d592-4e48-a2e2-6e86b4d82f2d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:12:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-06e20897-45f0-4cbe-b485-dbc78c83dfe4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:44 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-06e20897-45f0-4cbe-b485-dbc78c83dfe4 Jul 04 00:12:44 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:44 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3814f663-4f40-4cf8-a2f6-fe5f41e6e2ce tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed 1G" returned: 0 in 0.830s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3814f663-4f40-4cf8-a2f6-fe5f41e6e2ce tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8076011-49f6-479e-accd-b0f9b4826051 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:44 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8076011-49f6-479e-accd-b0f9b4826051 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed Jul 04 00:12:44 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:44 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-06e20897-45f0-4cbe-b485-dbc78c83dfe4" returned: 0 in 0.798s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-06e20897-45f0-4cbe-b485-dbc78c83dfe4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:44 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-06e20897-45f0-4cbe-b485-dbc78c83dfe4 Jul 04 00:12:44 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:45 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3814f663-4f40-4cf8-a2f6-fe5f41e6e2ce tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8076011-49f6-479e-accd-b0f9b4826051 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed" returned: 0 in 0.718s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:45 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-3814f663-4f40-4cf8-a2f6-fe5f41e6e2ce tempest-CreateVolumesFromSnapshotTest-456539927 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed is being set with open permissions: ugo+rw Jul 04 00:12:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3814f663-4f40-4cf8-a2f6-fe5f41e6e2ce tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:45 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed Jul 04 00:12:45 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:45 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-06e20897-45f0-4cbe-b485-dbc78c83dfe4" returned: 0 in 0.655s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-quobyte-06e20897-45f0-4cbe-b485-dbc78c83dfe4" released by "delete_volume" :: held 1.510s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:45 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] Created reservations ['ddd497ec-ab6c-4562-9b8e-a5ea32ff4cc7', '0f32f3af-2503-44e8-8259-f93927b8dc1e', '0479cf6c-27f2-45d0-87f4-7371a9298dc0', 'ebe54825-2d4a-4e3e-addd-1950a9fa3d34'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:12:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:45 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:12:45 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:45 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3814f663-4f40-4cf8-a2f6-fe5f41e6e2ce tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed" returned: 0 in 0.690s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3814f663-4f40-4cf8-a2f6-fe5f41e6e2ce tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:46 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.info Jul 04 00:12:46 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "cinder-10cfaf5e-32d3-4d94-aea0-21abac422485-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-10cfaf5e-32d3-4d94-aea0-21abac422485-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "cinder-quobyte-10cfaf5e-32d3-4d94-aea0-21abac422485" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-quobyte-10cfaf5e-32d3-4d94-aea0-21abac422485" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:46 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.708s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:46 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:12:46 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] Deleted volume successfully. Jul 04 00:12:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6eb714e-5361-487f-8016-da429cbc9e58]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:12:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-10cfaf5e-32d3-4d94-aea0-21abac422485 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f9df679a-4478-45b9-969a-4cc37fd7d2df tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-06e20897-45f0-4cbe-b485-dbc78c83dfe4-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:46 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-10cfaf5e-32d3-4d94-aea0-21abac422485 Jul 04 00:12:46 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:46 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3814f663-4f40-4cf8-a2f6-fe5f41e6e2ce tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.info" returned: 0 in 0.696s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:46 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-3814f663-4f40-4cf8-a2f6-fe5f41e6e2ce tempest-CreateVolumesFromSnapshotTest-456539927 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.info is being set with open permissions: ugo+rw Jul 04 00:12:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3814f663-4f40-4cf8-a2f6-fe5f41e6e2ce tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:46 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.info Jul 04 00:12:46 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:47 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-10cfaf5e-32d3-4d94-aea0-21abac422485" returned: 0 in 0.762s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-10cfaf5e-32d3-4d94-aea0-21abac422485 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:47 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-10cfaf5e-32d3-4d94-aea0-21abac422485 Jul 04 00:12:47 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:47 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3814f663-4f40-4cf8-a2f6-fe5f41e6e2ce tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.info" returned: 0 in 0.666s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3814f663-4f40-4cf8-a2f6-fe5f41e6e2ce tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.440s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.870s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-769330640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2167ff84-6317-4b26-8e87-1a34497e5b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3ad7e13def4406b4e4cd5c98ef6187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:36Z,use_quota=True,user_id='ae5c3746ba89415faf2edd85238ca881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Creating volume 2167ff84-6317-4b26-8e87-1a34497e5b8e {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:12:47 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2167ff84-6317-4b26-8e87-1a34497e5b8e 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:47 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2167ff84-6317-4b26-8e87-1a34497e5b8e 1073741824 Jul 04 00:12:47 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:47 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3814f663-4f40-4cf8-a2f6-fe5f41e6e2ce tempest-CreateVolumesFromSnapshotTest-456539927 None] Create snapshot completed successfully Jul 04 00:12:47 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-10cfaf5e-32d3-4d94-aea0-21abac422485" returned: 0 in 0.644s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-quobyte-10cfaf5e-32d3-4d94-aea0-21abac422485" released by "delete_volume" :: held 1.459s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] Created reservations ['5983c78c-50b2-470a-a6cd-4539e0969f86', '81af8a3b-23bc-450f-b845-760e408e7f8e', '05407315-35f2-4602-b7a6-89a93371ad5a', 'a0743a1f-abb4-4451-af7d-f22cfb5ff323'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:47 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:12:47 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:48 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2167ff84-6317-4b26-8e87-1a34497e5b8e 1073741824" returned: 0 in 0.790s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2167ff84-6317-4b26-8e87-1a34497e5b8e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:48 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2167ff84-6317-4b26-8e87-1a34497e5b8e Jul 04 00:12:48 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "cinder-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:48 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.670s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:48 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:12:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] Deleted volume successfully. Jul 04 00:12:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "cinder-quobyte-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9dc7375f-37a1-4e25-8f85-cd04c4eb916a tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-10cfaf5e-32d3-4d94-aea0-21abac422485-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-quobyte-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:48 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71e0436-e1eb-42b2-9625-af16fa6b1748]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:12:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:48 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8 Jul 04 00:12:48 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:48 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Flow 'volume_create_manager' (0daccb6e-fc23-457b-a392-52f5f2d7cf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46eaacd2-a06e-49a3-8a0b-b5d73e042558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46eaacd2-a06e-49a3-8a0b-b5d73e042558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1098927604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26f3ce7-c629-48c3-82b6-12e05ed934a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9fb51fa750b42acbac8a84b449f7e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:49Z,use_quota=True,user_id='f74834e7a32a4ae1b8f01237bbe1a7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:49 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d874b77-221c-4f3a-9775-d5a27e7312d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d874b77-221c-4f3a-9775-d5a27e7312d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c85bfe-1851-4364-91be-ddc8e4449e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c85bfe-1851-4364-91be-ddc8e4449e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a26f3ce7-c629-48c3-82b6-12e05ed934a3', 'volume_name': 'volume-a26f3ce7-c629-48c3-82b6-12e05ed934a3', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e794b6-3c1a-40dd-b492-c7ee24f90a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e794b6-3c1a-40dd-b492-c7ee24f90a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b722f15a-77c1-428f-8fde-3a95896115b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:49 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Volume a26f3ce7-c629-48c3-82b6-12e05ed934a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a26f3ce7-c629-48c3-82b6-12e05ed934a3', 'volume_size': 1} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2167ff84-6317-4b26-8e87-1a34497e5b8e" returned: 0 in 0.882s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.260s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1322057191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6084ec-d6c0-408e-8c85-8c46fa07047d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3ad7e13def4406b4e4cd5c98ef6187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:37Z,use_quota=True,user_id='ae5c3746ba89415faf2edd85238ca881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Creating volume cf6084ec-d6c0-408e-8c85-8c46fa07047d {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:12:49 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cf6084ec-d6c0-408e-8c85-8c46fa07047d 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d44383c-f714-407d-a097-dd223a7218a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2167ff84-6317-4b26-8e87-1a34497e5b8e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:49 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cf6084ec-d6c0-408e-8c85-8c46fa07047d 1073741824 Jul 04 00:12:49 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7f725d-3653-4a6a-b3ac-d0038e01d439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:49 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Volume volume-2167ff84-6317-4b26-8e87-1a34497e5b8e (2167ff84-6317-4b26-8e87-1a34497e5b8e): created successfully Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7f725d-3653-4a6a-b3ac-d0038e01d439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Flow 'volume_create_manager' (3717541a-ae44-4d40-9201-0997294cafcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:49 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-03c3cb74-0b16-41ee-af13-a45309aee6e8 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Created volume successfully. Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Flow 'volume_create_manager' (2790fbe2-ad0b-45c7-955b-a79ff49b0edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f658bd-7c8b-4fc2-8968-5934c3be04a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f658bd-7c8b-4fc2-8968-5934c3be04a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1178271379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbfe0b5f-8ef8-4ac3-b893-93cf019d236c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9fb51fa750b42acbac8a84b449f7e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:49Z,use_quota=True,user_id='f74834e7a32a4ae1b8f01237bbe1a7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd364e2-98da-45a1-9dc7-e05f0a062d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd364e2-98da-45a1-9dc7-e05f0a062d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a34ee43-0df5-4e96-a80a-0c4e2b6c4cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:49 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a34ee43-0df5-4e96-a80a-0c4e2b6c4cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbfe0b5f-8ef8-4ac3-b893-93cf019d236c', 'volume_name': 'volume-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c011ed4-14f4-4921-b550-3c905596e120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c011ed4-14f4-4921-b550-3c905596e120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff9b3da-844f-424f-8f6a-4e426e7bf8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:49 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Volume cbfe0b5f-8ef8-4ac3-b893-93cf019d236c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c', 'volume_size': 1} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8" returned: 0 in 0.965s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:49 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8 Jul 04 00:12:49 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:49 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Flow 'volume_create_manager' (4ba1732a-167c-412d-9fa8-967710831329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2492de2a-b46c-42da-b4e7-d3aae717f473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2492de2a-b46c-42da-b4e7-d3aae717f473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-5776922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2dd0663-591a-4e71-98d2-b65e88ec6c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9fb51fa750b42acbac8a84b449f7e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:50Z,use_quota=True,user_id='f74834e7a32a4ae1b8f01237bbe1a7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e9a769-5b28-4019-963d-d62f31efb9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e9a769-5b28-4019-963d-d62f31efb9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd40d9a9-bd52-4190-a7cd-e2d53a86a51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd40d9a9-bd52-4190-a7cd-e2d53a86a51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2dd0663-591a-4e71-98d2-b65e88ec6c16', 'volume_name': 'volume-d2dd0663-591a-4e71-98d2-b65e88ec6c16', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccefb390-6fd0-4494-9535-793f72e0eef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccefb390-6fd0-4494-9535-793f72e0eef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b42be15-8db9-4754-9822-9f268af58e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:50 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Volume d2dd0663-591a-4e71-98d2-b65e88ec6c16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2dd0663-591a-4e71-98d2-b65e88ec6c16', 'volume_size': 1} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Flow 'volume_create_manager' (266f6260-b4a4-48f0-972d-62b57b70f2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:50 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2338d9b-2103-4e31-b577-6924e73fded6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cf6084ec-d6c0-408e-8c85-8c46fa07047d 1073741824" returned: 0 in 1.130s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2338d9b-2103-4e31-b577-6924e73fded6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2004245871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9fb51fa750b42acbac8a84b449f7e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:50Z,use_quota=True,user_id='f74834e7a32a4ae1b8f01237bbe1a7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824b0af9-b5df-49ab-b29f-c4ebe458ac01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824b0af9-b5df-49ab-b29f-c4ebe458ac01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec97f03-7bf1-4159-a294-a54bd7fb21c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec97f03-7bf1-4159-a294-a54bd7fb21c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c', 'volume_name': 'volume-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e060a2e7-d971-4303-8a62-b9ab306421bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e060a2e7-d971-4303-8a62-b9ab306421bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a069a476-0711-4569-83f7-e862c48a4170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:50 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Volume 30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c', 'volume_size': 1} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cf6084ec-d6c0-408e-8c85-8c46fa07047d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:50 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cf6084ec-d6c0-408e-8c85-8c46fa07047d Jul 04 00:12:50 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:50 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8" returned: 0 in 0.881s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-quobyte-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8" released by "delete_volume" :: held 1.892s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] Created reservations ['1fa20b3f-25b3-4339-88ba-9bffcba91889', 'f3be88d5-5210-4a35-b6d7-cf608d741447', '025e79ec-1644-498e-b534-b366d39c1e01', '588553bd-999f-4e82-9701-5a886bce90ae'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:50 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:12:50 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Flow 'volume_create_manager' (51a7a911-da5d-4316-a732-f10836d91c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e19ccf-b590-4922-8043-c14e9b9387f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "cinder-d6ea5313-b5ad-4749-9d4d-d12e660611e9-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e19ccf-b590-4922-8043-c14e9b9387f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1914484085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536cd881-0064-4e34-8f8c-eccb86495f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9fb51fa750b42acbac8a84b449f7e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:51Z,use_quota=True,user_id='f74834e7a32a4ae1b8f01237bbe1a7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fa9714-0743-4836-bf9e-5432961c7fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fa9714-0743-4836-bf9e-5432961c7fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05df3e37-3a52-4dd9-8f4f-5e1ae9c9334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05df3e37-3a52-4dd9-8f4f-5e1ae9c9334a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '536cd881-0064-4e34-8f8c-eccb86495f26', 'volume_name': 'volume-536cd881-0064-4e34-8f8c-eccb86495f26', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4fbde7c-fbfc-4241-9d7a-473e5b9a4ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4fbde7c-fbfc-4241-9d7a-473e5b9a4ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b544ba58-5f48-4495-8134-cfdc3e0dbbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:50 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Volume 536cd881-0064-4e34-8f8c-eccb86495f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-536cd881-0064-4e34-8f8c-eccb86495f26', 'volume_size': 1} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-d6ea5313-b5ad-4749-9d4d-d12e660611e9-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "cinder-quobyte-d6ea5313-b5ad-4749-9d4d-d12e660611e9" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-quobyte-d6ea5313-b5ad-4749-9d4d-d12e660611e9" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[974be542-52d4-4bfa-87be-f01d4d039125]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:12:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d6ea5313-b5ad-4749-9d4d-d12e660611e9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:51 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d6ea5313-b5ad-4749-9d4d-d12e660611e9 Jul 04 00:12:51 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:51 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cf6084ec-d6c0-408e-8c85-8c46fa07047d" returned: 0 in 0.797s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] <== create_volume: return (2034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.037s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.843s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1836538939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ae0e71-c330-4914-b930-dbc9be016a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3ad7e13def4406b4e4cd5c98ef6187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:37Z,use_quota=True,user_id='ae5c3746ba89415faf2edd85238ca881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Creating volume 13ae0e71-c330-4914-b930-dbc9be016a36 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:12:51 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13ae0e71-c330-4914-b930-dbc9be016a36 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:51 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13ae0e71-c330-4914-b930-dbc9be016a36 1073741824 Jul 04 00:12:51 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8031599-a746-490f-a705-b3f7a0ae4176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf6084ec-d6c0-408e-8c85-8c46fa07047d', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6b472d-8953-418e-81a5-0b24963852e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:51 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Volume volume-cf6084ec-d6c0-408e-8c85-8c46fa07047d (cf6084ec-d6c0-408e-8c85-8c46fa07047d): created successfully Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6b472d-8953-418e-81a5-0b24963852e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Flow 'volume_create_manager' (0a802183-ee9b-402f-a017-880075f68913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:51 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4ddf3ecb-b7e1-4cc3-bd1e-e2f080671b1b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Created volume successfully. Jul 04 00:12:51 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.697s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:12:51 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] Deleted volume successfully. Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d082999c-fdda-4126-ae4d-129ada6ebda0 tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-f6de6d6a-2c1d-4b91-8f9b-e18872f6c4a8-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:51 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d6ea5313-b5ad-4749-9d4d-d12e660611e9" returned: 0 in 0.832s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d6ea5313-b5ad-4749-9d4d-d12e660611e9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:51 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d6ea5313-b5ad-4749-9d4d-d12e660611e9 Jul 04 00:12:51 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:52 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13ae0e71-c330-4914-b930-dbc9be016a36 1073741824" returned: 0 in 0.876s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13ae0e71-c330-4914-b930-dbc9be016a36 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:52 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13ae0e71-c330-4914-b930-dbc9be016a36 Jul 04 00:12:52 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:52 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d6ea5313-b5ad-4749-9d4d-d12e660611e9" returned: 0 in 0.634s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-quobyte-d6ea5313-b5ad-4749-9d4d-d12e660611e9" released by "delete_volume" :: held 1.506s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] Created reservations ['1b864074-e2f6-4f45-90ce-b9de55d809f4', 'd7179fc4-2a91-4ff6-8fca-61e6497c5f8d', 'ba7bb103-0eee-4c9e-b719-3b991f433b29', '7df072ae-765f-45e4-b91b-e28414ab58ee'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:52 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:12:52 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:52 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13ae0e71-c330-4914-b930-dbc9be016a36" returned: 0 in 0.686s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.080s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660937538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e1312c-8e3c-4728-a985-9dfdb1276ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3ad7e13def4406b4e4cd5c98ef6187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:38Z,use_quota=True,user_id='ae5c3746ba89415faf2edd85238ca881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Creating volume 36e1312c-8e3c-4728-a985-9dfdb1276ce1 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:12:52 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-36e1312c-8e3c-4728-a985-9dfdb1276ce1 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc79299-1eb2-4594-b356-3d95eb103e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13ae0e71-c330-4914-b930-dbc9be016a36', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:52 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-36e1312c-8e3c-4728-a985-9dfdb1276ce1 1073741824 Jul 04 00:12:52 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1263091-5bf1-41c2-8c6f-81dfbff2c00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:52 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Volume volume-13ae0e71-c330-4914-b930-dbc9be016a36 (13ae0e71-c330-4914-b930-dbc9be016a36): created successfully Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1263091-5bf1-41c2-8c6f-81dfbff2c00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Flow 'volume_create_manager' (5ec22e55-6969-4023-8859-0f6ad35c6702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:52 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e47212bc-8805-4dc3-8dd9-a022742ff20d tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Created volume successfully. Jul 04 00:12:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "cinder-02921c6a-67e3-438a-820d-19b735e4a6f6-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-02921c6a-67e3-438a-820d-19b735e4a6f6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "cinder-quobyte-02921c6a-67e3-438a-820d-19b735e4a6f6" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-quobyte-02921c6a-67e3-438a-820d-19b735e4a6f6" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ab8bf0-39ed-45cd-8732-fc766f7bf6da]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:12:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-02921c6a-67e3-438a-820d-19b735e4a6f6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:53 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.692s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:12:53 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] Deleted volume successfully. Jul 04 00:12:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ad31cf06-9ca4-475f-9f6c-48782a72562b tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-d6ea5313-b5ad-4749-9d4d-d12e660611e9-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:53 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-02921c6a-67e3-438a-820d-19b735e4a6f6 Jul 04 00:12:53 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:53 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-36e1312c-8e3c-4728-a985-9dfdb1276ce1 1073741824" returned: 0 in 0.934s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-36e1312c-8e3c-4728-a985-9dfdb1276ce1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:53 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-36e1312c-8e3c-4728-a985-9dfdb1276ce1 Jul 04 00:12:53 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:53 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-02921c6a-67e3-438a-820d-19b735e4a6f6" returned: 0 in 0.805s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-02921c6a-67e3-438a-820d-19b735e4a6f6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:53 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-02921c6a-67e3-438a-820d-19b735e4a6f6 Jul 04 00:12:53 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:54 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-36e1312c-8e3c-4728-a985-9dfdb1276ce1" returned: 0 in 0.667s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.267s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-101671302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae721ff-ed28-48e6-9507-71727b147cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3ad7e13def4406b4e4cd5c98ef6187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:38Z,use_quota=True,user_id='ae5c3746ba89415faf2edd85238ca881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Creating volume 4ae721ff-ed28-48e6-9507-71727b147cde {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:12:54 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4ae721ff-ed28-48e6-9507-71727b147cde 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:54 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4ae721ff-ed28-48e6-9507-71727b147cde 1073741824 Jul 04 00:12:54 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b7bcc4-1952-4642-9060-e407796eac21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36e1312c-8e3c-4728-a985-9dfdb1276ce1', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d38ef25-d278-4455-ab1b-62aa8be4e7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:54 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Volume volume-36e1312c-8e3c-4728-a985-9dfdb1276ce1 (36e1312c-8e3c-4728-a985-9dfdb1276ce1): created successfully Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d38ef25-d278-4455-ab1b-62aa8be4e7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Flow 'volume_create_manager' (fd431ef2-efee-4069-bc34-52a74f97500d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:54 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-852595c7-411f-4254-bbb5-68aa430e0f3b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Created volume successfully. Jul 04 00:12:54 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-02921c6a-67e3-438a-820d-19b735e4a6f6" returned: 0 in 0.635s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-quobyte-02921c6a-67e3-438a-820d-19b735e4a6f6" released by "delete_volume" :: held 1.502s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] Created reservations ['badc94ee-1a8c-4137-a67b-80cb11e89f99', '17ca5b27-9b3c-4a0a-81d9-3e48429de410', '9bd02c47-d3d8-4f6d-b3fb-8594af593a29', '3445572f-c19a-40d8-94c8-0212c64a2c83'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:54 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:12:54 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:55 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4ae721ff-ed28-48e6-9507-71727b147cde 1073741824" returned: 0 in 0.873s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4ae721ff-ed28-48e6-9507-71727b147cde {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:55 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4ae721ff-ed28-48e6-9507-71727b147cde Jul 04 00:12:55 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:55 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.750s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:55 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:12:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] Deleted volume successfully. Jul 04 00:12:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f1737c97-51b7-4700-a6b6-00e0e1d4e89b tempest-CreateVolumesFromImageTest-551164080 None] Lock "cinder-02921c6a-67e3-438a-820d-19b735e4a6f6-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:56 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4ae721ff-ed28-48e6-9507-71727b147cde" returned: 0 in 0.713s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.971s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acc387ab-4963-4222-bf8a-883c3f2ded88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b81c48a66b4958af789e51e5966839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:35Z,use_quota=True,user_id='01687a96e71d4977922f7500d3474ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f3e1739-6491-4d73-8040-7b569ac6d8c8),volume_type_id=9f3e1739-6491-4d73-8040-7b569ac6d8c8)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Creating volume acc387ab-4963-4222-bf8a-883c3f2ded88 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:12:56 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e075b1bc-9d79-4291-ae90-0bddd720752e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae721ff-ed28-48e6-9507-71727b147cde', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:56 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 1073741824 Jul 04 00:12:56 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e588d30c-06ef-41e3-87b1-83882cf9b7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:56 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Volume volume-4ae721ff-ed28-48e6-9507-71727b147cde (4ae721ff-ed28-48e6-9507-71727b147cde): created successfully Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e588d30c-06ef-41e3-87b1-83882cf9b7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Flow 'volume_create_manager' (2a91ad95-4988-4cde-8253-b891a96c72ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:56 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-928311f3-bfcf-49f2-80d1-b45af9c4a908 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Created volume successfully. Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "cinder-4ae721ff-ed28-48e6-9507-71727b147cde-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-4ae721ff-ed28-48e6-9507-71727b147cde-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "cinder-quobyte-4ae721ff-ed28-48e6-9507-71727b147cde" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-quobyte-4ae721ff-ed28-48e6-9507-71727b147cde" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b29051-6f4b-484d-b9fc-b8758b164633]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:12:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4ae721ff-ed28-48e6-9507-71727b147cde {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:56 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4ae721ff-ed28-48e6-9507-71727b147cde Jul 04 00:12:56 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:57 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 1073741824" returned: 0 in 1.079s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:57 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 Jul 04 00:12:57 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:57 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4ae721ff-ed28-48e6-9507-71727b147cde" returned: 0 in 0.902s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4ae721ff-ed28-48e6-9507-71727b147cde {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:57 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4ae721ff-ed28-48e6-9507-71727b147cde Jul 04 00:12:57 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:57 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88" returned: 0 in 0.715s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:12:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.841s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1098927604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26f3ce7-c629-48c3-82b6-12e05ed934a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9fb51fa750b42acbac8a84b449f7e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:49Z,use_quota=True,user_id='f74834e7a32a4ae1b8f01237bbe1a7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:12:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Creating volume a26f3ce7-c629-48c3-82b6-12e05ed934a3 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:12:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:12:57 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:12:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a26f3ce7-c629-48c3-82b6-12e05ed934a3 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:57 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a26f3ce7-c629-48c3-82b6-12e05ed934a3 1073741824 Jul 04 00:12:57 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Attempting download of 929f33cb-7da8-47b8-b5d1-bd8756eed958 ((None, [{'url': 'file:///opt/stack/data/glance/images/929f33cb-7da8-47b8-b5d1-bd8756eed958', 'metadata': {}}])) to volume acc387ab-4963-4222-bf8a-883c3f2ded88. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f664f44-61cb-445f-a2b4-0cacd4695acd]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_929f33cb-7da8-47b8-b5d1-bd8756eed958_gzkyye6c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:58 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_929f33cb-7da8-47b8-b5d1-bd8756eed958_gzkyye6c Jul 04 00:12:58 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:58 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-4ae721ff-ed28-48e6-9507-71727b147cde" returned: 0 in 0.868s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-quobyte-4ae721ff-ed28-48e6-9507-71727b147cde" released by "delete_volume" :: held 1.825s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Flow 'volume_create_manager' (825f8554-83ff-4505-9704-3bdc6a0e00ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d55f59-ee3a-4209-82e6-5fa348221273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d55f59-ee3a-4209-82e6-5fa348221273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-886496112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21096165-323c-438d-af6b-89ad425f2d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1309142cf25f47b1bc82a24ff24b4b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:59Z,use_quota=True,user_id='f8da2501eef84089806f515b396fe94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3022c8e-6388-4284-b510-968ecbb37acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3022c8e-6388-4284-b510-968ecbb37acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8e1ffc-911c-42ba-9e4e-2a3f53800181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8e1ffc-911c-42ba-9e4e-2a3f53800181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21096165-323c-438d-af6b-89ad425f2d2f', 'volume_name': 'volume-21096165-323c-438d-af6b-89ad425f2d2f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c6f2d9-f43e-4e00-886a-f2f4eb5a6865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c6f2d9-f43e-4e00-886a-f2f4eb5a6865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee87ea9-fb60-41ec-a291-35469bfdd1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:12:58 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Volume 21096165-323c-438d-af6b-89ad425f2d2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21096165-323c-438d-af6b-89ad425f2d2f', 'volume_size': 1} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Created reservations ['9bdedeae-d491-448c-8e60-d5d72ec11962', '2ad1c65d-6eb2-4a81-bf45-aad2a595e96f', 'a24bf900-82b5-44c8-a4b4-ef9aa23f5140', '04812ee6-5cf2-4e0e-8fdb-28e279d4d68b'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:58 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:12:58 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "cinder-36e1312c-8e3c-4728-a985-9dfdb1276ce1-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:58 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_929f33cb-7da8-47b8-b5d1-bd8756eed958_gzkyye6c" returned: 0 in 0.902s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_929f33cb-7da8-47b8-b5d1-bd8756eed958_gzkyye6c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-36e1312c-8e3c-4728-a985-9dfdb1276ce1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "cinder-quobyte-36e1312c-8e3c-4728-a985-9dfdb1276ce1" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:12:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-quobyte-36e1312c-8e3c-4728-a985-9dfdb1276ce1" acquired by "delete_volume" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:12:59 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[578c48e4-3d75-4547-97c9-57cad99c815b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:12:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-36e1312c-8e3c-4728-a985-9dfdb1276ce1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:59 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_929f33cb-7da8-47b8-b5d1-bd8756eed958_gzkyye6c Jul 04 00:12:59 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:59 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a26f3ce7-c629-48c3-82b6-12e05ed934a3 1073741824" returned: 0 in 1.205s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a26f3ce7-c629-48c3-82b6-12e05ed934a3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:59 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a26f3ce7-c629-48c3-82b6-12e05ed934a3 Jul 04 00:12:59 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:59 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-36e1312c-8e3c-4728-a985-9dfdb1276ce1 Jul 04 00:12:59 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:59 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.896s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:59 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:12:59 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Deleted volume successfully. Jul 04 00:12:59 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_929f33cb-7da8-47b8-b5d1-bd8756eed958_gzkyye6c" returned: 1 in 0.831s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_929f33cb-7da8-47b8-b5d1-bd8756eed958_gzkyye6c' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:12:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-722c50d5-fd15-4234-a9d3-ede5f55fd688 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-4ae721ff-ed28-48e6-9507-71727b147cde-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:12:59 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[791051c1-0c3a-4d4d-98da-6168a3ebdabe]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:12:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:12:59 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD Jul 04 00:12:59 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:12:59 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Jul 04 00:12:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-36e1312c-8e3c-4728-a985-9dfdb1276ce1" returned: 0 in 0.839s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:12:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-36e1312c-8e3c-4728-a985-9dfdb1276ce1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:00 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:00 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-36e1312c-8e3c-4728-a985-9dfdb1276ce1 Jul 04 00:13:00 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a26f3ce7-c629-48c3-82b6-12e05ed934a3" returned: 0 in 0.811s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] <== create_volume: return (2075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.527s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1178271379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbfe0b5f-8ef8-4ac3-b893-93cf019d236c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9fb51fa750b42acbac8a84b449f7e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:49Z,use_quota=True,user_id='f74834e7a32a4ae1b8f01237bbe1a7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Creating volume cbfe0b5f-8ef8-4ac3-b893-93cf019d236c {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:13:00 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:00 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c 1073741824 Jul 04 00:13:00 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b722f15a-77c1-428f-8fde-3a95896115b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a26f3ce7-c629-48c3-82b6-12e05ed934a3', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e065d739-fda8-4ab5-99c1-629863ef2050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:00 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Volume volume-a26f3ce7-c629-48c3-82b6-12e05ed934a3 (a26f3ce7-c629-48c3-82b6-12e05ed934a3): created successfully Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e065d739-fda8-4ab5-99c1-629863ef2050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Flow 'volume_create_manager' (0daccb6e-fc23-457b-a392-52f5f2d7cf77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:13:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a77ed536-2815-417c-9182-f62fae6532bf tempest-CreateVolumesFromSnapshotTest-456539927 None] Created volume successfully. Jul 04 00:13:00 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD" returned: 0 in 0.866s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:00 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-36e1312c-8e3c-4728-a985-9dfdb1276ce1" returned: 0 in 0.769s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-quobyte-36e1312c-8e3c-4728-a985-9dfdb1276ce1" released by "delete_volume" :: held 1.651s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:00 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD Jul 04 00:13:00 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Created reservations ['7dd12da3-1ecd-49b4-b818-8125c533bf97', 'a18ecf03-2335-484f-a2c0-5bfdbb5660a8', 'aef9c30e-cd11-4303-b8a3-1c4c6823e12d', '7329afe0-c5b4-4168-ac4c-a782dc49886f'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:00 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:13:00 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:00 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c 1073741824" returned: 0 in 0.936s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:01 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c Jul 04 00:13:01 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "cinder-13ae0e71-c330-4914-b930-dbc9be016a36-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-13ae0e71-c330-4914-b930-dbc9be016a36-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "cinder-quobyte-13ae0e71-c330-4914-b930-dbc9be016a36" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:01 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD" returned: 1 in 0.765s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] 929f33cb-7da8-47b8-b5d1-bd8756eed958 was raw, converting to raw {{(pid=86676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-quobyte-13ae0e71-c330-4914-b930-dbc9be016a36" acquired by "delete_volume" :: waited 0.048s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:01 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 Jul 04 00:13:01 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfccd5a-ea08-4156-bf01-e19831ecca13]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13ae0e71-c330-4914-b930-dbc9be016a36 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:01 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13ae0e71-c330-4914-b930-dbc9be016a36 Jul 04 00:13:01 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:01 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.730s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:13:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Deleted volume successfully. Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-594939f0-96c5-47a1-938f-4c13d8255cdf tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-36e1312c-8e3c-4728-a985-9dfdb1276ce1-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:01 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c" returned: 0 in 0.828s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.746s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-5776922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2dd0663-591a-4e71-98d2-b65e88ec6c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9fb51fa750b42acbac8a84b449f7e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:50Z,use_quota=True,user_id='f74834e7a32a4ae1b8f01237bbe1a7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Creating volume d2dd0663-591a-4e71-98d2-b65e88ec6c16 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:13:01 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d2dd0663-591a-4e71-98d2-b65e88ec6c16 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:01 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d2dd0663-591a-4e71-98d2-b65e88ec6c16 1073741824 Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff9b3da-844f-424f-8f6a-4e426e7bf8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:01 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d947c3a-3c22-4284-8f64-ea43b431f8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:01 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Volume volume-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c (cbfe0b5f-8ef8-4ac3-b893-93cf019d236c): created successfully Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d947c3a-3c22-4284-8f64-ea43b431f8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Flow 'volume_create_manager' (2790fbe2-ad0b-45c7-955b-a79ff49b0edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:13:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e7f7d9a0-9f40-4a6a-970a-338bb2d7f3a9 tempest-CreateVolumesFromSnapshotTest-456539927 None] Created volume successfully. Jul 04 00:13:02 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88" returned: 0 in 0.792s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:02 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_929f33cb-7da8-47b8-b5d1-bd8756eed958_61u87d4qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 04 00:13:02 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Converted 0.00 MB image at 0.00 MB/s Jul 04 00:13:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:02 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 1G Jul 04 00:13:02 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:02 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13ae0e71-c330-4914-b930-dbc9be016a36" returned: 0 in 0.811s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13ae0e71-c330-4914-b930-dbc9be016a36 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:02 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13ae0e71-c330-4914-b930-dbc9be016a36 Jul 04 00:13:02 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:02 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d2dd0663-591a-4e71-98d2-b65e88ec6c16 1073741824" returned: 0 in 0.922s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d2dd0663-591a-4e71-98d2-b65e88ec6c16 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:02 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d2dd0663-591a-4e71-98d2-b65e88ec6c16 Jul 04 00:13:02 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:02 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 1G" returned: 0 in 0.733s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:03 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-13ae0e71-c330-4914-b930-dbc9be016a36" returned: 0 in 0.697s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-quobyte-13ae0e71-c330-4914-b930-dbc9be016a36" released by "delete_volume" :: held 1.554s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[719c31af-3ce6-4515-affd-0b8c43db7759]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Created reservations ['29a0e92e-6225-4bf8-af1f-6b0b6568e4e3', '8affca64-a4df-4fe9-9145-c7eb1aa5d602', '04be4611-3383-423c-93a0-5e787d40255d', 'da49f1a1-188d-4115-ad0f-0e39eb3332e8'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:03 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 Jul 04 00:13:03 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:03 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:13:03 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:03 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d2dd0663-591a-4e71-98d2-b65e88ec6c16" returned: 0 in 0.699s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.226s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2004245871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9fb51fa750b42acbac8a84b449f7e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:50Z,use_quota=True,user_id='f74834e7a32a4ae1b8f01237bbe1a7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Creating volume 30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:13:03 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:03 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c 1073741824 Jul 04 00:13:03 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b42be15-8db9-4754-9822-9f268af58e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2dd0663-591a-4e71-98d2-b65e88ec6c16', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a05ba75-30f6-455a-a368-a727fab5cb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:03 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Volume volume-d2dd0663-591a-4e71-98d2-b65e88ec6c16 (d2dd0663-591a-4e71-98d2-b65e88ec6c16): created successfully Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a05ba75-30f6-455a-a368-a727fab5cb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Flow 'volume_create_manager' (4ba1732a-167c-412d-9fa8-967710831329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "cinder-cf6084ec-d6c0-408e-8c85-8c46fa07047d-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:03 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-67d7abce-c436-4db6-ac44-b3661972ef81 tempest-CreateVolumesFromSnapshotTest-456539927 None] Created volume successfully. Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-cf6084ec-d6c0-408e-8c85-8c46fa07047d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "cinder-quobyte-cf6084ec-d6c0-408e-8c85-8c46fa07047d" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-quobyte-cf6084ec-d6c0-408e-8c85-8c46fa07047d" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b02f90-6b0b-4ed7-8fd5-2eb4a1133560]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cf6084ec-d6c0-408e-8c85-8c46fa07047d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:03 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cf6084ec-d6c0-408e-8c85-8c46fa07047d Jul 04 00:13:03 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:04 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:04 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88" returned: 0 in 0.970s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.836s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:13:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Deleted volume successfully. Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4abcbdf6-77a0-43d1-9961-230d07d21053 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-13ae0e71-c330-4914-b930-dbc9be016a36-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:04 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 Jul 04 00:13:04 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:04 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c 1073741824" returned: 0 in 0.921s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:04 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c Jul 04 00:13:04 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:04 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cf6084ec-d6c0-408e-8c85-8c46fa07047d" returned: 0 in 0.871s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cf6084ec-d6c0-408e-8c85-8c46fa07047d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:04 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cf6084ec-d6c0-408e-8c85-8c46fa07047d Jul 04 00:13:04 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:04 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88" returned: 1 in 0.793s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Downloaded image 929f33cb-7da8-47b8-b5d1-bd8756eed958 ((None, [{'url': 'file:///opt/stack/data/glance/images/929f33cb-7da8-47b8-b5d1-bd8756eed958', 'metadata': {}}])) to volume acc387ab-4963-4222-bf8a-883c3f2ded88 successfully. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Temporary image 929f33cb-7da8-47b8-b5d1-bd8756eed958 for user 01687a96e71d4977922f7500d3474ea9 is deleted. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Marking volume acc387ab-4963-4222-bf8a-883c3f2ded88 as bootable. {{(pid=86676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Copying metadata from image 929f33cb-7da8-47b8-b5d1-bd8756eed958 to acc387ab-4963-4222-bf8a-883c3f2ded88. {{(pid=86676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Creating volume glance metadata for volume acc387ab-4963-4222-bf8a-883c3f2ded88 backed by image 929f33cb-7da8-47b8-b5d1-bd8756eed958 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '929f33cb-7da8-47b8-b5d1-bd8756eed958', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fa23c002da7621078ebefb24b5412f81', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e350979-845f-4055-9de7-dc649f0d51a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acc387ab-4963-4222-bf8a-883c3f2ded88', 'volume_size': 1, 'image_id': '929f33cb-7da8-47b8-b5d1-bd8756eed958', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/929f33cb-7da8-47b8-b5d1-bd8756eed958', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fa23c002da7621078ebefb24b5412f81', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '10b81c48a66b4958af789e51e5966839', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ad4e265d80df9bb17e48c377dbe674829903e9035e216dc95779af0eb95ea02e915e2444c151e29a482f5d05b294a6222ed3aa5ba0f42b1d6dab450895eecb64', 'id': '929f33cb-7da8-47b8-b5d1-bd8756eed958', 'created_at': datetime.datetime(2026, 7, 3, 22, 12, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 12, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/929f33cb-7da8-47b8-b5d1-bd8756eed958/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8cd8b50-df48-4b3e-b6a9-2c878a82eeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:04 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Volume volume-acc387ab-4963-4222-bf8a-883c3f2ded88 (acc387ab-4963-4222-bf8a-883c3f2ded88): created successfully Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8cd8b50-df48-4b3e-b6a9-2c878a82eeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Flow 'volume_create_manager' (6252ec4c-9563-49d8-9b3c-8bf21422864c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:13:05 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-80f5cb35-f499-4459-ab3a-7c7715885727 tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Created volume successfully. Jul 04 00:13:05 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c" returned: 0 in 0.716s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.415s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1914484085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536cd881-0064-4e34-8f8c-eccb86495f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9fb51fa750b42acbac8a84b449f7e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:51Z,use_quota=True,user_id='f74834e7a32a4ae1b8f01237bbe1a7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Creating volume 536cd881-0064-4e34-8f8c-eccb86495f26 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:13:05 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-536cd881-0064-4e34-8f8c-eccb86495f26 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a069a476-0711-4569-83f7-e862c48a4170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:05 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-536cd881-0064-4e34-8f8c-eccb86495f26 1073741824 Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15564bf3-3671-44c1-8cbf-990d1594736c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:05 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:05 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Volume volume-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c (30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c): created successfully Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15564bf3-3671-44c1-8cbf-990d1594736c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Flow 'volume_create_manager' (266f6260-b4a4-48f0-972d-62b57b70f2a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:13:05 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c1fa1e03-da3b-4a53-9aef-3535febd762b tempest-CreateVolumesFromSnapshotTest-456539927 None] Created volume successfully. Jul 04 00:13:05 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cf6084ec-d6c0-408e-8c85-8c46fa07047d" returned: 0 in 0.761s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-quobyte-cf6084ec-d6c0-408e-8c85-8c46fa07047d" released by "delete_volume" :: held 1.711s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Created reservations ['fd40661e-61ad-458e-a2fe-65dde11f8f25', '8e0041d0-af30-41f9-b005-358f5d4dafcb', '92e81cb9-a565-40f6-a6a0-64a2b9e389e5', '7b1d2268-ec3a-400b-848c-9a6b93c0291a'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:05 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:13:05 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "cinder-2167ff84-6317-4b26-8e87-1a34497e5b8e-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-2167ff84-6317-4b26-8e87-1a34497e5b8e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "cinder-quobyte-2167ff84-6317-4b26-8e87-1a34497e5b8e" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-quobyte-2167ff84-6317-4b26-8e87-1a34497e5b8e" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:06 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[32da2347-eae2-4160-b671-eebf6e25ba66]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2167ff84-6317-4b26-8e87-1a34497e5b8e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Acquiring lock "cinder-acc387ab-4963-4222-bf8a-883c3f2ded88-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Lock "cinder-acc387ab-4963-4222-bf8a-883c3f2ded88-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:06 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2167ff84-6317-4b26-8e87-1a34497e5b8e Jul 04 00:13:06 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Acquiring lock "cinder-quobyte-acc387ab-4963-4222-bf8a-883c3f2ded88" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Lock "cinder-quobyte-acc387ab-4963-4222-bf8a-883c3f2ded88" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:06 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-536cd881-0064-4e34-8f8c-eccb86495f26 1073741824" returned: 0 in 1.055s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:06 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdb77c3-67ef-47a5-971c-c95f27d01b75]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-536cd881-0064-4e34-8f8c-eccb86495f26 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:06 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-536cd881-0064-4e34-8f8c-eccb86495f26 Jul 04 00:13:06 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:06 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.838s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:06 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:13:06 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Deleted volume successfully. Jul 04 00:13:06 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 Jul 04 00:13:06 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-803b115f-1dab-4ce3-8fc0-abc98697f3ce tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-cf6084ec-d6c0-408e-8c85-8c46fa07047d-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:06 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2167ff84-6317-4b26-8e87-1a34497e5b8e" returned: 0 in 0.831s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2167ff84-6317-4b26-8e87-1a34497e5b8e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:06 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2167ff84-6317-4b26-8e87-1a34497e5b8e Jul 04 00:13:06 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:07 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-536cd881-0064-4e34-8f8c-eccb86495f26" returned: 0 in 0.666s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.294s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-886496112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21096165-323c-438d-af6b-89ad425f2d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1309142cf25f47b1bc82a24ff24b4b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:59Z,use_quota=True,user_id='f8da2501eef84089806f515b396fe94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Creating volume 21096165-323c-438d-af6b-89ad425f2d2f {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:13:07 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b544ba58-5f48-4495-8134-cfdc3e0dbbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-536cd881-0064-4e34-8f8c-eccb86495f26', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:07 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f 1073741824 Jul 04 00:13:07 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04bc28cb-b913-48e7-894a-851356dc02a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:07 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Volume volume-536cd881-0064-4e34-8f8c-eccb86495f26 (536cd881-0064-4e34-8f8c-eccb86495f26): created successfully Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04bc28cb-b913-48e7-894a-851356dc02a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Flow 'volume_create_manager' (51a7a911-da5d-4316-a732-f10836d91c6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:13:07 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6197334e-3fa4-4085-9dc1-384d957a5d4d tempest-CreateVolumesFromSnapshotTest-456539927 None] Created volume successfully. Jul 04 00:13:07 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88" returned: 0 in 0.888s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "cinder-536cd881-0064-4e34-8f8c-eccb86495f26-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-536cd881-0064-4e34-8f8c-eccb86495f26-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:07 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 Jul 04 00:13:07 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "cinder-quobyte-536cd881-0064-4e34-8f8c-eccb86495f26" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-quobyte-536cd881-0064-4e34-8f8c-eccb86495f26" acquired by "delete_volume" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcd3612-8105-46da-9c4e-2593aaf1b02a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-536cd881-0064-4e34-8f8c-eccb86495f26 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:07 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-536cd881-0064-4e34-8f8c-eccb86495f26 Jul 04 00:13:07 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:07 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2167ff84-6317-4b26-8e87-1a34497e5b8e" returned: 0 in 0.867s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-quobyte-2167ff84-6317-4b26-8e87-1a34497e5b8e" released by "delete_volume" :: held 1.751s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Created reservations ['9a6a30bb-ed57-4547-a2ab-b449230eb2be', '5f609eab-0bc0-498d-8acf-fb6681fa8638', '965ca0f4-8ac9-48f0-84ef-1a87ff488064', '6c4dc4d4-1def-4486-9797-c5474112e3a5'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:08 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:13:08 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:08 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f 1073741824" returned: 0 in 1.015s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:08 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f Jul 04 00:13:08 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:08 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88" returned: 1 in 1.017s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:13:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:08 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88 Jul 04 00:13:08 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "cinder-b4a404d2-e347-468b-887f-1daac64c4971-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-b4a404d2-e347-468b-887f-1daac64c4971-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "cinder-quobyte-b4a404d2-e347-468b-887f-1daac64c4971" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-quobyte-b4a404d2-e347-468b-887f-1daac64c4971" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:08 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75f45e9-92e1-4b76-ad7f-c7ef9e6f8e80]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b4a404d2-e347-468b-887f-1daac64c4971 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:08 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b4a404d2-e347-468b-887f-1daac64c4971 Jul 04 00:13:08 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:08 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-536cd881-0064-4e34-8f8c-eccb86495f26" returned: 0 in 1.241s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-536cd881-0064-4e34-8f8c-eccb86495f26 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:08 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-536cd881-0064-4e34-8f8c-eccb86495f26 Jul 04 00:13:08 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:09 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.051s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:13:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Deleted volume successfully. Jul 04 00:13:09 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f" returned: 0 in 0.900s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-839a1e11-a53b-4ba3-b31a-75eabd4d6105 tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-2167ff84-6317-4b26-8e87-1a34497e5b8e-delete_volume" released by "delete_volume" :: held 3.103s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee87ea9-fb60-41ec-a291-35469bfdd1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21096165-323c-438d-af6b-89ad425f2d2f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9b9980-614b-4d96-ac78-9b0f019e6047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:09 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Volume volume-21096165-323c-438d-af6b-89ad425f2d2f (21096165-323c-438d-af6b-89ad425f2d2f): created successfully Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9b9980-614b-4d96-ac78-9b0f019e6047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Flow 'volume_create_manager' (825f8554-83ff-4505-9704-3bdc6a0e00ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:13:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8734fa1d-d9f2-408a-91d8-95d5cb734cd8 tempest-VolumeDependencyTests-855768649 None] Created volume successfully. Jul 04 00:13:09 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-acc387ab-4963-4222-bf8a-883c3f2ded88" returned: 0 in 0.891s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Lock "cinder-quobyte-acc387ab-4963-4222-bf8a-883c3f2ded88" released by "delete_volume" :: held 2.872s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Created reservations ['26940479-f854-495b-a76a-bd31e6d35c9b', '406415c3-dac5-4df0-87ff-91084195ccae', '0b45e5a7-de6b-4767-8116-241196cee253', '15696dfa-e7d8-4d6f-8fd0-179b1f08cc9b'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:09 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:13:09 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:09 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-536cd881-0064-4e34-8f8c-eccb86495f26" returned: 0 in 0.824s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:09 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b4a404d2-e347-468b-887f-1daac64c4971" returned: 0 in 1.022s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b4a404d2-e347-468b-887f-1daac64c4971 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-quobyte-536cd881-0064-4e34-8f8c-eccb86495f26" released by "delete_volume" :: held 2.156s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:09 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b4a404d2-e347-468b-887f-1daac64c4971 Jul 04 00:13:09 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] Created reservations ['c16a7188-7fa7-4832-85d0-6f1d492e9d94', 'e12595e2-9d5b-405d-9c9a-ea62dd53cfe7', 'd91348eb-1f14-447f-a45f-e4b4603e07ad', '56c490d0-32f6-4d7b-843c-e10b921b96e1'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a4e3840-9180-43e7-a3be-53785978850e tempest-VolumeDependencyTests-855768649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a4e3840-9180-43e7-a3be-53785978850e tempest-VolumeDependencyTests-855768649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1a4e3840-9180-43e7-a3be-53785978850e tempest-VolumeDependencyTests-855768649 None] Creating offline snapshot 3560476b-f609-49ce-b482-fee319d1e084 of volume 21096165-323c-438d-af6b-89ad425f2d2f {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf90e13-070f-41b3-9ed6-a7fdb92e262e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a4e3840-9180-43e7-a3be-53785978850e tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:09 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:13:09 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:10 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.767s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:13:10 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f Jul 04 00:13:10 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Deleted volume successfully. Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b7edb90d-06e1-4c24-ab8d-234798fe69cd tempest-VolumeAndVolumeTypeFromImageTest-1526245702 None] Lock "cinder-acc387ab-4963-4222-bf8a-883c3f2ded88-delete_volume" released by "delete_volume" :: held 3.893s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:10 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b4a404d2-e347-468b-887f-1daac64c4971" returned: 0 in 0.900s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-quobyte-b4a404d2-e347-468b-887f-1daac64c4971" released by "delete_volume" :: held 1.981s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Created reservations ['9c421558-fe73-42aa-83dc-312c445ed5ba', '66f72ae4-fa2d-485b-aa5b-ad5ef450238b', 'a5bcc095-6c5d-45c1-b11a-0c8c4310556d', '91dbcaf5-cc1f-4d39-9386-595b6b1ae0a7'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:10 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:13:10 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "cinder-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:10 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.923s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:13:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] Deleted volume successfully. Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "cinder-quobyte-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-quobyte-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6e582e01-5194-41e1-b99e-de7d36c1bdac tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-536cd881-0064-4e34-8f8c-eccb86495f26-delete_volume" released by "delete_volume" :: held 3.556s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80ccb71-357a-4ce2-8ec2-09237a645321]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:10 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a4e3840-9180-43e7-a3be-53785978850e tempest-VolumeDependencyTests-855768649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f" returned: 0 in 1.071s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a4e3840-9180-43e7-a3be-53785978850e tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:11 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084 1G Jul 04 00:13:11 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:11 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c Jul 04 00:13:11 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:11 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.898s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:11 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:13:11 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Deleted volume successfully. Jul 04 00:13:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-73eb945c-6d18-49de-b15a-d071a5d6a91b tempest-CreateVolumesFromSourceVolumeTest-1991606191 None] Lock "cinder-b4a404d2-e347-468b-887f-1daac64c4971-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:11 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c" returned: 0 in 0.883s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:11 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c Jul 04 00:13:11 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:12 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a4e3840-9180-43e7-a3be-53785978850e tempest-VolumeDependencyTests-855768649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084 1G" returned: 0 in 1.099s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a4e3840-9180-43e7-a3be-53785978850e tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21096165-323c-438d-af6b-89ad425f2d2f -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:12 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21096165-323c-438d-af6b-89ad425f2d2f -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084 Jul 04 00:13:12 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:12 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c" returned: 0 in 0.885s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-quobyte-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c" released by "delete_volume" :: held 1.836s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:12 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] Created reservations ['96e255a3-8f0b-4eb7-a51e-c1ce7fe10fcc', '4e304914-8cce-434d-8c6a-c8ff284085dc', '14b41c10-3d72-4020-ad3e-8f76c6cc2ba5', '425d274c-8a13-4ab3-b979-e466b0744f10'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:13 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:13:13 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:13 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a4e3840-9180-43e7-a3be-53785978850e tempest-VolumeDependencyTests-855768649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21096165-323c-438d-af6b-89ad425f2d2f -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084" returned: 0 in 1.001s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:13 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-1a4e3840-9180-43e7-a3be-53785978850e tempest-VolumeDependencyTests-855768649 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084 is being set with open permissions: ugo+rw Jul 04 00:13:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a4e3840-9180-43e7-a3be-53785978850e tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:13 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084 Jul 04 00:13:13 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "cinder-d2dd0663-591a-4e71-98d2-b65e88ec6c16-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-d2dd0663-591a-4e71-98d2-b65e88ec6c16-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "cinder-quobyte-d2dd0663-591a-4e71-98d2-b65e88ec6c16" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-quobyte-d2dd0663-591a-4e71-98d2-b65e88ec6c16" acquired by "delete_volume" :: waited 0.034s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:13 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84619f3-fb60-4940-96c9-e0863de5e0bc]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d2dd0663-591a-4e71-98d2-b65e88ec6c16 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:13 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d2dd0663-591a-4e71-98d2-b65e88ec6c16 Jul 04 00:13:13 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:13 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a4e3840-9180-43e7-a3be-53785978850e tempest-VolumeDependencyTests-855768649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084" returned: 0 in 0.896s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a4e3840-9180-43e7-a3be-53785978850e tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:14 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.info Jul 04 00:13:14 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:14 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.256s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:14 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:13:14 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] Deleted volume successfully. Jul 04 00:13:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2b243ed4-1bfa-422f-b94c-032d106d6e96 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-30e1fac2-9cf8-49c8-9b45-3e5433ec4b6c-delete_volume" released by "delete_volume" :: held 3.446s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:14 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d2dd0663-591a-4e71-98d2-b65e88ec6c16" returned: 0 in 1.093s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d2dd0663-591a-4e71-98d2-b65e88ec6c16 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:14 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d2dd0663-591a-4e71-98d2-b65e88ec6c16 Jul 04 00:13:14 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:14 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a4e3840-9180-43e7-a3be-53785978850e tempest-VolumeDependencyTests-855768649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.info" returned: 0 in 0.880s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:14 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-1a4e3840-9180-43e7-a3be-53785978850e tempest-VolumeDependencyTests-855768649 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.info is being set with open permissions: ugo+rw Jul 04 00:13:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a4e3840-9180-43e7-a3be-53785978850e tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:14 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.info Jul 04 00:13:14 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:15 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d2dd0663-591a-4e71-98d2-b65e88ec6c16" returned: 0 in 0.751s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-quobyte-d2dd0663-591a-4e71-98d2-b65e88ec6c16" released by "delete_volume" :: held 1.937s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] Created reservations ['87e41060-2d5e-49a3-a586-13f2f3b26e89', 'ddc80705-93ba-4441-a328-2ca75f08b96d', '0668d3cb-8b25-424f-8b6e-0957fe1ba542', '5a7bff20-daec-4616-9431-ab59a79e3eae'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:15 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:13:15 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "cinder-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "cinder-quobyte-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-quobyte-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[badfe198-0da6-42b5-9b36-f26ed05e8586]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:15 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c Jul 04 00:13:15 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:13:15 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Flow 'volume_create_manager' (c67a4d5b-9348-4a4b-84a2-e53369be3471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b65245b-2fec-444f-a2e3-a830369aa99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a4e3840-9180-43e7-a3be-53785978850e tempest-VolumeDependencyTests-855768649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.info" returned: 0 in 1.048s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a4e3840-9180-43e7-a3be-53785978850e tempest-VolumeDependencyTests-855768649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.151s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b65245b-2fec-444f-a2e3-a830369aa99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15fd9e6d-f490-4bf4-989f-6f2fc11a1717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d5a5d700644d03beabfe5bb32545d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:13:16Z,use_quota=True,user_id='da246d7a784144c7a4ac839e6fb20413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed14eda-15c7-4bcb-8f9a-639515ef708e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed14eda-15c7-4bcb-8f9a-639515ef708e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86d88b7-4f41-42a9-b0f0-4f380fdcfad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86d88b7-4f41-42a9-b0f0-4f380fdcfad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15fd9e6d-f490-4bf4-989f-6f2fc11a1717', 'volume_name': 'volume-15fd9e6d-f490-4bf4-989f-6f2fc11a1717', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278f6f15-2853-4275-829a-537769c36f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278f6f15-2853-4275-829a-537769c36f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ccac9f8-721b-4ace-99bc-0df4bea8a685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:16 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Volume 15fd9e6d-f490-4bf4-989f-6f2fc11a1717: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15fd9e6d-f490-4bf4-989f-6f2fc11a1717', 'volume_size': 1} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15fd9e6d-f490-4bf4-989f-6f2fc11a1717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d5a5d700644d03beabfe5bb32545d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:13:16Z,use_quota=True,user_id='da246d7a784144c7a4ac839e6fb20413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Creating volume 15fd9e6d-f490-4bf4-989f-6f2fc11a1717 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:13:16 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-15fd9e6d-f490-4bf4-989f-6f2fc11a1717 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1a4e3840-9180-43e7-a3be-53785978850e tempest-VolumeDependencyTests-855768649 None] Create snapshot completed successfully Jul 04 00:13:16 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-15fd9e6d-f490-4bf4-989f-6f2fc11a1717 1073741824 Jul 04 00:13:16 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:16 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.852s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:13:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] Deleted volume successfully. Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b9a04858-470a-447c-9246-2bdf2fca06da tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-d2dd0663-591a-4e71-98d2-b65e88ec6c16-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:16 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c" returned: 0 in 0.895s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:16 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c Jul 04 00:13:16 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:17 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-15fd9e6d-f490-4bf4-989f-6f2fc11a1717 1073741824" returned: 0 in 0.994s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-15fd9e6d-f490-4bf4-989f-6f2fc11a1717 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:17 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-15fd9e6d-f490-4bf4-989f-6f2fc11a1717 Jul 04 00:13:17 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:17 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c" returned: 0 in 0.666s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-quobyte-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c" released by "delete_volume" :: held 1.633s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:17 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] Created reservations ['095f75be-9c01-4e47-8101-f45f35a4a75a', '2e2ae4d3-edb7-4738-ab58-9f9f689b89d6', '132bc31e-7db2-4191-8b79-1001fcca9eb7', '4137f665-b232-4a26-b4f5-77c07ef26dd9'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:17 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:13:17 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:17 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:13:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "cinder-a26f3ce7-c629-48c3-82b6-12e05ed934a3-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Flow 'volume_create_manager' (8d76ddc1-9410-4268-879d-b54b2f20a3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:13:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3668a0b8-1ceb-4a68-8cc1-b4eda6a135d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:17 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-15fd9e6d-f490-4bf4-989f-6f2fc11a1717" returned: 0 in 0.867s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-a26f3ce7-c629-48c3-82b6-12e05ed934a3-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3668a0b8-1ceb-4a68-8cc1-b4eda6a135d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-429422446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c28bb1a-78e2-4a76-8ff7-b8ada80d0748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1309142cf25f47b1bc82a24ff24b4b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3560476b-f609-49ce-b482-fee319d1e084,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:13:18Z,use_quota=True,user_id='f8da2501eef84089806f515b396fe94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a5ddc2-c0f3-440b-b97e-f21305de9d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a5ddc2-c0f3-440b-b97e-f21305de9d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc7eba7-071b-43c6-a0d5-da87926f40b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc7eba7-071b-43c6-a0d5-da87926f40b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5c28bb1a-78e2-4a76-8ff7-b8ada80d0748', 'volume_name': 'volume-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748', 'volume_size': 1, 'snapshot_id': '3560476b-f609-49ce-b482-fee319d1e084'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bd4660-4771-4436-860c-3ca700b5f994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bd4660-4771-4436-860c-3ca700b5f994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12c55d6-97cf-448d-b097-867bfc1b2b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:18 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Volume 5c28bb1a-78e2-4a76-8ff7-b8ada80d0748: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748', 'volume_size': 1, 'snapshot_id': '3560476b-f609-49ce-b482-fee319d1e084'} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ccac9f8-721b-4ace-99bc-0df4bea8a685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15fd9e6d-f490-4bf4-989f-6f2fc11a1717', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3c325b-4db6-4cfc-8b6c-d08672026539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Acquiring lock "cinder-quobyte-3560476b-f609-49ce-b482-fee319d1e084-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748" by "_create_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:18 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Volume volume-15fd9e6d-f490-4bf4-989f-6f2fc11a1717 (15fd9e6d-f490-4bf4-989f-6f2fc11a1717): created successfully Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3c325b-4db6-4cfc-8b6c-d08672026539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Flow 'volume_create_manager' (c67a4d5b-9348-4a4b-84a2-e53369be3471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Lock "cinder-quobyte-3560476b-f609-49ce-b482-fee319d1e084-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Creating volume 5c28bb1a-78e2-4a76-8ff7-b8ada80d0748 from snapshot 3560476b-f609-49ce-b482-fee319d1e084 {{(pid=86676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Acquiring lock "cinder-quobyte-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-66f7d3cc-54e7-4d4f-95cf-28fd39df15cd tempest-CinderUnicodeTest-60615541 None] Created volume successfully. Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "cinder-quobyte-a26f3ce7-c629-48c3-82b6-12e05ed934a3" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Lock "cinder-quobyte-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] snapshot: 3560476b-f609-49ce-b482-fee319d1e084, volume: 5c28bb1a-78e2-4a76-8ff7-b8ada80d0748, {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-quobyte-a26f3ce7-c629-48c3-82b6-12e05ed934a3" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaac0e6-d8bc-471c-b168-4f4ab1e1ee7a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a26f3ce7-c629-48c3-82b6-12e05ed934a3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6e1c8e-a535-418e-b45e-291a24ac0046]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:18 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a26f3ce7-c629-48c3-82b6-12e05ed934a3 Jul 04 00:13:18 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:18 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.907s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:13:18 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084 Jul 04 00:13:18 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] Deleted volume successfully. Jul 04 00:13:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e525fb3e-fb1b-426a-b57f-2b53d14e1332 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-cbfe0b5f-8ef8-4ac3-b893-93cf019d236c-delete_volume" released by "delete_volume" :: held 2.843s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:19 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a26f3ce7-c629-48c3-82b6-12e05ed934a3" returned: 0 in 0.898s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a26f3ce7-c629-48c3-82b6-12e05ed934a3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:19 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084" returned: 0 in 0.911s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:19 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a26f3ce7-c629-48c3-82b6-12e05ed934a3 Jul 04 00:13:19 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21096165-323c-438d-af6b-89ad425f2d2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaf9a80-5a7f-4b8d-84b7-05cf35e80f87]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:19 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f Jul 04 00:13:19 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Flow 'volume_create_manager' (21642c3e-3faa-4940-8c10-2d834c40a3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113bd370-23de-45c2-b89c-244d55b69cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113bd370-23de-45c2-b89c-244d55b69cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26efd9e-13a7-4a6f-8e0c-611251dd91c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f5cb45c05544b3ba871226fdcf3bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:13:19Z,use_quota=True,user_id='8d8b2febcc8540c8889abedea894306b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d39288d-8bb1-4211-8c0e-62e79e4928f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d39288d-8bb1-4211-8c0e-62e79e4928f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7be4b8-a184-4eb5-862d-e94b8dd53b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.image.glance [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Creating Keystone auth plugin from conf {{(pid=86676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7be4b8-a184-4eb5-862d-e94b8dd53b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e26efd9e-13a7-4a6f-8e0c-611251dd91c1', 'volume_name': 'volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1', 'volume_size': 1, 'image_id': '8c0d2119-a95e-48dd-8efb-b906eacb5e10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c0d2119-a95e-48dd-8efb-b906eacb5e10', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4a99708c7301034c4e30d73530da0228', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '93f5cb45c05544b3ba871226fdcf3bca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '82862a7af95729246d1f22776edd42310fea657bdfc54b91a43547a687118c10a6f5ff98071e92322ace35b86fcc2a01c5e953963b0267e43fc6a00c0cbe8399', 'id': '8c0d2119-a95e-48dd-8efb-b906eacb5e10', 'created_at': datetime.datetime(2026, 7, 3, 22, 13, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 13, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c0d2119-a95e-48dd-8efb-b906eacb5e10/file', 'properties': {}}, 'image_service': }' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6275bc6a-20a2-41c9-8a51-0be49dea803d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6275bc6a-20a2-41c9-8a51-0be49dea803d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4fe976-1375-4230-90ae-9a4529581baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:19 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Volume e26efd9e-13a7-4a6f-8e0c-611251dd91c1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1', 'volume_size': 1, 'image_id': '8c0d2119-a95e-48dd-8efb-b906eacb5e10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c0d2119-a95e-48dd-8efb-b906eacb5e10', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4a99708c7301034c4e30d73530da0228', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '93f5cb45c05544b3ba871226fdcf3bca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '82862a7af95729246d1f22776edd42310fea657bdfc54b91a43547a687118c10a6f5ff98071e92322ace35b86fcc2a01c5e953963b0267e43fc6a00c0cbe8399', 'id': '8c0d2119-a95e-48dd-8efb-b906eacb5e10', 'created_at': datetime.datetime(2026, 7, 3, 22, 13, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 13, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c0d2119-a95e-48dd-8efb-b906eacb5e10/file', 'properties': {}}, 'image_service': } Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Trying to clone e26efd9e-13a7-4a6f-8e0c-611251dd91c1 from image 8c0d2119-a95e-48dd-8efb-b906eacb5e10 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c0d2119-a95e-48dd-8efb-b906eacb5e10', 'metadata': {}}]). {{(pid=86676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Flow 'volume_create_manager' (20bc1670-8144-4086-bea9-881b5dd58a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902dcade-5551-4c30-bebc-06596979b25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902dcade-5551-4c30-bebc-06596979b25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:13:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1252072986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00bd295d-1651-43fb-9ded-1511db1db949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d5a5d700644d03beabfe5bb32545d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:13:20Z,use_quota=True,user_id='da246d7a784144c7a4ac839e6fb20413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d28e0ac-6f89-46fb-a27f-ea0e8949bac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d28e0ac-6f89-46fb-a27f-ea0e8949bac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8656833-ae3a-40ea-8b07-c8620d28f4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8656833-ae3a-40ea-8b07-c8620d28f4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00bd295d-1651-43fb-9ded-1511db1db949', 'volume_name': 'volume-00bd295d-1651-43fb-9ded-1511db1db949', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a6d052-d54a-43d6-975a-7b6d5078ce0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a6d052-d54a-43d6-975a-7b6d5078ce0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b5888d-5a95-4152-b5ac-5e92c8283101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:20 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Volume 00bd295d-1651-43fb-9ded-1511db1db949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00bd295d-1651-43fb-9ded-1511db1db949', 'volume_size': 1} Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 04 00:13:20 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Image download 0.00 MB at 0.00 MB/s Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06b81a0-b1f3-425f-9448-1e082b08e901]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:20 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a26f3ce7-c629-48c3-82b6-12e05ed934a3" returned: 0 in 0.946s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-quobyte-a26f3ce7-c629-48c3-82b6-12e05ed934a3" released by "delete_volume" :: held 1.930s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:20 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD Jul 04 00:13:20 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] Created reservations ['62c10c80-ffd0-441e-aa46-047e7455ec2b', 'b3fea64c-8266-444b-8d02-338838f68f77', '28d1969b-452b-4381-b881-c0b3628d04b0', '305534cf-eb80-4dd6-87e9-a8cf35ff9643'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:20 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f" returned: 0 in 0.962s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Path /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748 not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:20 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748 Jul 04 00:13:20 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:20 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:13:20 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:20 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD" returned: 0 in 0.725s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:20 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD Jul 04 00:13:20 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:20 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.667s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:13:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] Deleted volume successfully. Jul 04 00:13:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b22b4694-f231-4f24-89db-83f1f9cf136a tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-a26f3ce7-c629-48c3-82b6-12e05ed934a3-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "cinder-4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "cinder-quobyte-b8076011-49f6-479e-accd-b0f9b4826051" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-quobyte-b8076011-49f6-479e-accd-b0f9b4826051" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "cinder-quobyte-4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-quobyte-4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] Deleting offline snapshot 4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed of volume b8076011-49f6-479e-accd-b0f9b4826051 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:13:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] snapshot_file for this snap is: volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:13:21 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3156e20a-e6d8-493d-9184-4e6d37cc0147]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:22 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed Jul 04 00:13:22 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:22 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD" returned: 1 in 1.603s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:13:22 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Temporary image 8c0d2119-a95e-48dd-8efb-b906eacb5e10 is fetched for user 8d8b2febcc8540c8889abedea894306b. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 04 00:13:22 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fb5099-7efe-403c-a8a4-8484cf5888af]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:22 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD Jul 04 00:13:22 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:23 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD" returned: 0 in 1.240s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:24 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD Jul 04 00:13:24 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:24 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed" returned: 0 in 2.843s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8076011-49f6-479e-accd-b0f9b4826051(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:13:24 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[150c32ff-61b7-4c72-8bd1-6548bc842793]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:24 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051 Jul 04 00:13:24 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:25 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD" returned: 1 in 1.605s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:13:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:25 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748" returned: 0 in 5.274s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:25 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1789abfc-f0e6-42db-8c3f-1b94d5a00816]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:25 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f Jul 04 00:13:25 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:25 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051" returned: 0 in 1.074s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:25 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed Jul 04 00:13:25 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:26 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f" returned: 0 in 0.913s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:26 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f, size 1024.00 MB, duration 5.27 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 04 00:13:26 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Converted 1024.00 MB image at 194.14 MB/s Jul 04 00:13:26 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748 is being set with open permissions: ugo+rw Jul 04 00:13:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:26 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748 Jul 04 00:13:26 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:26 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed" returned: 0 in 0.734s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:26 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed Jul 04 00:13:26 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:27 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748" returned: 0 in 0.612s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Lock "cinder-quobyte-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748" released by "_copy_volume_from_snapshot" :: held 8.834s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Lock "cinder-quobyte-3560476b-f609-49ce-b482-fee319d1e084-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748" released by "_create_volume_from_snapshot" :: held 8.887s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.943s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.022s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:13:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1252072986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00bd295d-1651-43fb-9ded-1511db1db949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d5a5d700644d03beabfe5bb32545d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:13:20Z,use_quota=True,user_id='da246d7a784144c7a4ac839e6fb20413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Creating volume 00bd295d-1651-43fb-9ded-1511db1db949 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:13:27 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=200,cinder:SELECT=147,cinder:INSERT=52,cinder:DELETE=14 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:13:27 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:27 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949 1073741824 Jul 04 00:13:27 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051.4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed" returned: 0 in 0.645s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=141,cinder:UPDATE=206,cinder:INSERT=49,cinder:DELETE=25 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12c55d6-97cf-448d-b097-867bfc1b2b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748', 'volume_size': 1, 'snapshot_id': '3560476b-f609-49ce-b482-fee319d1e084'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208a92ee-3e13-4be8-9001-7f69f7654072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-quobyte-4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed" released by "_delete_snapshot" :: held 5.515s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:27 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Volume volume-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748 (5c28bb1a-78e2-4a76-8ff7-b8ada80d0748): created successfully Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208a92ee-3e13-4be8-9001-7f69f7654072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Flow 'volume_create_manager' (8d76ddc1-9410-4268-879d-b54b2f20a3a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-quobyte-b8076011-49f6-479e-accd-b0f9b4826051" released by "delete_snapshot" :: held 5.583s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8e23c0f2-47fb-468e-b817-1c0c3a2a4083 tempest-VolumeDependencyTests-855768649 None] Created volume successfully. Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] Created reservations ['9fa4d3f1-0554-41e4-8838-f6e24e9be520', '5877bbd1-5864-4900-9699-0fd7cb4f17c7', '96a67e03-ba09-4125-a45c-4add311b2f88', '5b7436e2-ec09-4617-9225-0a322fb89618'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] Delete snapshot completed successfully. Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7d58af63-ec19-47c3-84b8-579c720fc8ec tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-4da93363-ed5c-4cbe-b2dc-7f9fb81c82ed-delete_snapshot" released by "delete_snapshot" :: held 5.756s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] Acquiring lock "cinder-3560476b-f609-49ce-b482-fee319d1e084-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] Lock "cinder-3560476b-f609-49ce-b482-fee319d1e084-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] Acquiring lock "cinder-quobyte-21096165-323c-438d-af6b-89ad425f2d2f" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] Lock "cinder-quobyte-21096165-323c-438d-af6b-89ad425f2d2f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] Acquiring lock "cinder-quobyte-3560476b-f609-49ce-b482-fee319d1e084" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] Lock "cinder-quobyte-3560476b-f609-49ce-b482-fee319d1e084" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] Deleting offline snapshot 3560476b-f609-49ce-b482-fee319d1e084 of volume 21096165-323c-438d-af6b-89ad425f2d2f {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] snapshot_file for this snap is: volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ab17e5-b0f9-4e26-9066-4187497c46ae]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:27 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949 1073741824" returned: 0 in 0.850s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:27 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084 Jul 04 00:13:27 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:27 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949 Jul 04 00:13:27 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "cinder-b8076011-49f6-479e-accd-b0f9b4826051-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-b8076011-49f6-479e-accd-b0f9b4826051-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "cinder-quobyte-b8076011-49f6-479e-accd-b0f9b4826051" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-quobyte-b8076011-49f6-479e-accd-b0f9b4826051" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0eeb84-df23-45ab-b730-325f9384e0a4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:28 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051 Jul 04 00:13:28 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:28 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949" returned: 0 in 0.682s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.194s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26efd9e-13a7-4a6f-8e0c-611251dd91c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f5cb45c05544b3ba871226fdcf3bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:13:19Z,use_quota=True,user_id='8d8b2febcc8540c8889abedea894306b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Creating volume e26efd9e-13a7-4a6f-8e0c-611251dd91c1 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:13:28 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:28 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:28 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 1073741824 Jul 04 00:13:28 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084" returned: 0 in 0.829s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21096165-323c-438d-af6b-89ad425f2d2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b5888d-5a95-4152-b5ac-5e92c8283101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00bd295d-1651-43fb-9ded-1511db1db949', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98b56ba-b28e-4467-88a8-7049b8487890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce8e463-00f9-49fd-ab65-dfc400369473]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:28 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Volume volume-00bd295d-1651-43fb-9ded-1511db1db949 (00bd295d-1651-43fb-9ded-1511db1db949): created successfully Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98b56ba-b28e-4467-88a8-7049b8487890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Flow 'volume_create_manager' (20bc1670-8144-4086-bea9-881b5dd58a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:13:28 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-763bae98-09ad-4893-8ac5-71c85526d54b tempest-CinderUnicodeTest-60615541 None] Created volume successfully. Jul 04 00:13:28 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f Jul 04 00:13:28 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:28 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051" returned: 0 in 0.827s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:29 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051 Jul 04 00:13:29 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:29 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 1073741824" returned: 0 in 0.821s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:29 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:29 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 Jul 04 00:13:29 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f" returned: 0 in 0.817s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:29 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084 Jul 04 00:13:29 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:29 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b8076011-49f6-479e-accd-b0f9b4826051" returned: 0 in 0.704s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-quobyte-b8076011-49f6-479e-accd-b0f9b4826051" released by "delete_volume" :: held 1.605s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:29 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Created reservations ['762cf81c-9d2c-4b70-bd44-6093e90335ef', 'c5df658c-c67c-4696-9f22-1e910115428c', 'ec9e0bfa-c842-4e4f-a671-1a96e47f36e2', 'e6a06bb3-40ad-41c1-9e9b-1fbb55f057d8'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:29 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:13:29 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b72ff896-19dc-44b8-bcfa-397635c850f8 tempest-CinderUnicodeTest-60615541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:30 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1" returned: 0 in 0.790s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:13:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b72ff896-19dc-44b8-bcfa-397635c850f8 tempest-CinderUnicodeTest-60615541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.267s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b72ff896-19dc-44b8-bcfa-397635c850f8 tempest-CinderUnicodeTest-60615541 None] Creating offline snapshot 96804865-0915-49c5-a8f0-f6ad8e9c026c of volume 00bd295d-1651-43fb-9ded-1511db1db949 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:13:30 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Attempting download of 8c0d2119-a95e-48dd-8efb-b906eacb5e10 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c0d2119-a95e-48dd-8efb-b906eacb5e10', 'metadata': {}}])) to volume e26efd9e-13a7-4a6f-8e0c-611251dd91c1. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 04 00:13:30 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0392232e-7d31-445c-ab71-d5fe427da003]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b72ff896-19dc-44b8-bcfa-397635c850f8 tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:30 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1697d2a7-a03e-46be-8ca7-60fe14252771]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c0d2119-a95e-48dd-8efb-b906eacb5e10_u_7vk1qh {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:30 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084" returned: 0 in 0.940s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:30 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084 Jul 04 00:13:30 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:30 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949 Jul 04 00:13:30 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:30 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c0d2119-a95e-48dd-8efb-b906eacb5e10_u_7vk1qh Jul 04 00:13:30 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:30 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.885s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:30 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:13:30 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Deleted volume successfully. Jul 04 00:13:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cababc57-7b55-4ba3-8e78-373fa930e8c6 tempest-CreateVolumesFromSnapshotTest-456539927 None] Lock "cinder-b8076011-49f6-479e-accd-b0f9b4826051-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:31 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f.3560476b-f609-49ce-b482-fee319d1e084" returned: 0 in 0.788s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] Lock "cinder-quobyte-3560476b-f609-49ce-b482-fee319d1e084" released by "_delete_snapshot" :: held 3.524s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] Lock "cinder-quobyte-21096165-323c-438d-af6b-89ad425f2d2f" released by "delete_snapshot" :: held 3.552s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:31 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b72ff896-19dc-44b8-bcfa-397635c850f8 tempest-CinderUnicodeTest-60615541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949" returned: 0 in 1.026s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b72ff896-19dc-44b8-bcfa-397635c850f8 tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:31 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c 1G Jul 04 00:13:31 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:31 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c0d2119-a95e-48dd-8efb-b906eacb5e10_u_7vk1qh" returned: 0 in 1.021s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c0d2119-a95e-48dd-8efb-b906eacb5e10_u_7vk1qh {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:31 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] Created reservations ['31eedb96-1091-43cd-a97f-a09edfc67c7c', '0575790f-5559-448e-b10e-5a83174c6935', '4630dd86-87ba-4123-aef5-7e5202dfff46', 'f12d25ab-0c60-4ab4-9c89-8f64c83468d8'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:31 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] Delete snapshot completed successfully. Jul 04 00:13:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8c663890-e235-4580-9abe-38a6311d5064 tempest-VolumeDependencyTests-855768649 None] Lock "cinder-3560476b-f609-49ce-b482-fee319d1e084-delete_snapshot" released by "delete_snapshot" :: held 3.799s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:31 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c0d2119-a95e-48dd-8efb-b906eacb5e10_u_7vk1qh Jul 04 00:13:31 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] Acquiring lock "cinder-21096165-323c-438d-af6b-89ad425f2d2f-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] Lock "cinder-21096165-323c-438d-af6b-89ad425f2d2f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] Acquiring lock "cinder-quobyte-21096165-323c-438d-af6b-89ad425f2d2f" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] Lock "cinder-quobyte-21096165-323c-438d-af6b-89ad425f2d2f" acquired by "delete_volume" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:32 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[814b19d5-2724-4c5c-a262-3e4e51c8ac8c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:32 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c0d2119-a95e-48dd-8efb-b906eacb5e10_u_7vk1qh" returned: 1 in 0.951s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c0d2119-a95e-48dd-8efb-b906eacb5e10_u_7vk1qh' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:13:32 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f Jul 04 00:13:32 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:32 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d963ba-df66-4462-94b7-e2b67d55cfb3]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:32 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b72ff896-19dc-44b8-bcfa-397635c850f8 tempest-CinderUnicodeTest-60615541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c 1G" returned: 0 in 1.089s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b72ff896-19dc-44b8-bcfa-397635c850f8 tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00bd295d-1651-43fb-9ded-1511db1db949 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:32 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD Jul 04 00:13:32 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:32 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00bd295d-1651-43fb-9ded-1511db1db949 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c Jul 04 00:13:32 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:33 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD" returned: 0 in 0.818s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:33 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f" returned: 0 in 1.002s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:33 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f Jul 04 00:13:33 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:33 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b72ff896-19dc-44b8-bcfa-397635c850f8 tempest-CinderUnicodeTest-60615541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00bd295d-1651-43fb-9ded-1511db1db949 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c" returned: 0 in 0.867s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:33 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-b72ff896-19dc-44b8-bcfa-397635c850f8 tempest-CinderUnicodeTest-60615541 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c is being set with open permissions: ugo+rw Jul 04 00:13:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b72ff896-19dc-44b8-bcfa-397635c850f8 tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:33 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD Jul 04 00:13:33 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:33 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c Jul 04 00:13:33 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:13:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:33 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:13:33 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:34 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD" returned: 1 in 0.882s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] 8c0d2119-a95e-48dd-8efb-b906eacb5e10 was raw, converting to raw {{(pid=86676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:34 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 Jul 04 00:13:34 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:34 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-21096165-323c-438d-af6b-89ad425f2d2f" returned: 0 in 0.944s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:34 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b72ff896-19dc-44b8-bcfa-397635c850f8 tempest-CinderUnicodeTest-60615541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c" returned: 0 in 0.881s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] Lock "cinder-quobyte-21096165-323c-438d-af6b-89ad425f2d2f" released by "delete_volume" :: held 2.039s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b72ff896-19dc-44b8-bcfa-397635c850f8 tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:34 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:34 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.info Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] Created reservations ['6a4acda5-1058-4e35-8bec-0fa2565def1e', 'c3281610-29d5-4632-86fd-0bf3df511e56', '42b5a559-7930-45fe-b725-c83e98ab399f', '8e5490dc-a8a7-488c-b137-ee00e86dd005'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:34 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.957s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:34 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:13:34 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:35 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1" returned: 0 in 0.925s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:35 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c0d2119-a95e-48dd-8efb-b906eacb5e10_mie0t5yodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 04 00:13:35 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Converted 0.00 MB image at 0.00 MB/s Jul 04 00:13:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:35 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b72ff896-19dc-44b8-bcfa-397635c850f8 tempest-CinderUnicodeTest-60615541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.info" returned: 0 in 0.754s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:35 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-b72ff896-19dc-44b8-bcfa-397635c850f8 tempest-CinderUnicodeTest-60615541 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.info is being set with open permissions: ugo+rw Jul 04 00:13:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b72ff896-19dc-44b8-bcfa-397635c850f8 tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:35 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 1G Jul 04 00:13:35 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:35 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.info Jul 04 00:13:35 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:35 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.834s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:35 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:13:35 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] Deleted volume successfully. Jul 04 00:13:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-40d4f589-816b-43b5-bf20-6eb4028c9171 tempest-VolumeDependencyTests-855768649 None] Lock "cinder-21096165-323c-438d-af6b-89ad425f2d2f-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] Acquiring lock "cinder-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] Lock "cinder-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] Acquiring lock "cinder-quobyte-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] Lock "cinder-quobyte-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:35 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d80f32-ffd9-4f52-a5d9-b07e92f33f88]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:35 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748 Jul 04 00:13:35 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:35 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b72ff896-19dc-44b8-bcfa-397635c850f8 tempest-CinderUnicodeTest-60615541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.info" returned: 0 in 0.690s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:35 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b72ff896-19dc-44b8-bcfa-397635c850f8 tempest-CinderUnicodeTest-60615541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.474s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 1G" returned: 0 in 0.728s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:35 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b72ff896-19dc-44b8-bcfa-397635c850f8 tempest-CinderUnicodeTest-60615541 None] Create snapshot completed successfully Jul 04 00:13:35 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d1cd59-558c-4516-a42a-497e5d82e5bb]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:35 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 Jul 04 00:13:35 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] Acquiring lock "cinder-96804865-0915-49c5-a8f0-f6ad8e9c026c-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] Lock "cinder-96804865-0915-49c5-a8f0-f6ad8e9c026c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] Acquiring lock "cinder-quobyte-00bd295d-1651-43fb-9ded-1511db1db949" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] Lock "cinder-quobyte-00bd295d-1651-43fb-9ded-1511db1db949" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] Acquiring lock "cinder-quobyte-96804865-0915-49c5-a8f0-f6ad8e9c026c" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] Lock "cinder-quobyte-96804865-0915-49c5-a8f0-f6ad8e9c026c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] Deleting offline snapshot 96804865-0915-49c5-a8f0-f6ad8e9c026c of volume 00bd295d-1651-43fb-9ded-1511db1db949 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:13:36 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] snapshot_file for this snap is: volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:13:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748" returned: 0 in 0.871s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:36 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb4fe55-2498-4f82-82c1-b0f4bbc31ae7]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:36 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748 Jul 04 00:13:36 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:36 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c Jul 04 00:13:36 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:36 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1" returned: 0 in 0.960s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:36 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 Jul 04 00:13:36 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:37 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748" returned: 0 in 0.776s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] Lock "cinder-quobyte-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748" released by "delete_volume" :: held 1.689s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] Created reservations ['01837d41-066f-477d-9997-6f144659e0bb', '6116374f-3437-4100-ae0e-aa1489de5831', 'fb6a1d57-50b1-452f-8689-98df6e092903', 'bab03dbe-1713-4b8b-9818-34ddc88e81e7'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:37 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c" returned: 0 in 0.861s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00bd295d-1651-43fb-9ded-1511db1db949(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e57bee-d0e8-4435-9bd8-025992edcbe2]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:37 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:13:37 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:37 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949 Jul 04 00:13:37 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:37 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1" returned: 1 in 0.836s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Downloaded image 8c0d2119-a95e-48dd-8efb-b906eacb5e10 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c0d2119-a95e-48dd-8efb-b906eacb5e10', 'metadata': {}}])) to volume e26efd9e-13a7-4a6f-8e0c-611251dd91c1 successfully. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Temporary image 8c0d2119-a95e-48dd-8efb-b906eacb5e10 for user 8d8b2febcc8540c8889abedea894306b is deleted. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Marking volume e26efd9e-13a7-4a6f-8e0c-611251dd91c1 as bootable. {{(pid=86676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Copying metadata from image 8c0d2119-a95e-48dd-8efb-b906eacb5e10 to e26efd9e-13a7-4a6f-8e0c-611251dd91c1. {{(pid=86676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Creating volume glance metadata for volume e26efd9e-13a7-4a6f-8e0c-611251dd91c1 backed by image 8c0d2119-a95e-48dd-8efb-b906eacb5e10 with: {'image_id': '8c0d2119-a95e-48dd-8efb-b906eacb5e10', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4a99708c7301034c4e30d73530da0228', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4fe976-1375-4230-90ae-9a4529581baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1', 'volume_size': 1, 'image_id': '8c0d2119-a95e-48dd-8efb-b906eacb5e10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c0d2119-a95e-48dd-8efb-b906eacb5e10', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4a99708c7301034c4e30d73530da0228', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '93f5cb45c05544b3ba871226fdcf3bca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '82862a7af95729246d1f22776edd42310fea657bdfc54b91a43547a687118c10a6f5ff98071e92322ace35b86fcc2a01c5e953963b0267e43fc6a00c0cbe8399', 'id': '8c0d2119-a95e-48dd-8efb-b906eacb5e10', 'created_at': datetime.datetime(2026, 7, 3, 22, 13, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 13, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c0d2119-a95e-48dd-8efb-b906eacb5e10/file', 'properties': {}}, 'image_service': }' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94458d8f-445d-4deb-99ee-b533d037efdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:37 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Volume volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 (e26efd9e-13a7-4a6f-8e0c-611251dd91c1): created successfully Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94458d8f-445d-4deb-99ee-b533d037efdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Flow 'volume_create_manager' (21642c3e-3faa-4940-8c10-2d834c40a3a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:13:37 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d356a147-ac52-4f9b-881f-26cfd0526d86 tempest-VolumeImageDependencyTests-739579268 None] Created volume successfully. Jul 04 00:13:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] Acquiring lock "cinder-e26efd9e-13a7-4a6f-8e0c-611251dd91c1-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] Lock "cinder-e26efd9e-13a7-4a6f-8e0c-611251dd91c1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:38 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.914s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:38 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:13:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] Deleted volume successfully. Jul 04 00:13:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] Acquiring lock "cinder-quobyte-e26efd9e-13a7-4a6f-8e0c-611251dd91c1" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] Lock "cinder-quobyte-e26efd9e-13a7-4a6f-8e0c-611251dd91c1" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:38 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-01f3a4f7-d659-4cac-93f2-c0a5adecc5d1 tempest-VolumeDependencyTests-855768649 None] Lock "cinder-5c28bb1a-78e2-4a76-8ff7-b8ada80d0748-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949" returned: 0 in 1.056s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:38 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c Jul 04 00:13:38 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:38 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1161cb1-d0df-4968-89be-a5751f0077db]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:38 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 Jul 04 00:13:38 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:39 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1" returned: 0 in 0.866s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:39 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 Jul 04 00:13:39 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:39 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c" returned: 0 in 1.068s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:39 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c Jul 04 00:13:39 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:40 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1" returned: 1 in 0.833s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 04 00:13:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:40 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1 Jul 04 00:13:40 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:40 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949.96804865-0915-49c5-a8f0-f6ad8e9c026c" returned: 0 in 0.751s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] Lock "cinder-quobyte-96804865-0915-49c5-a8f0-f6ad8e9c026c" released by "_delete_snapshot" :: held 3.886s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] Lock "cinder-quobyte-00bd295d-1651-43fb-9ded-1511db1db949" released by "delete_snapshot" :: held 3.921s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:40 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] Created reservations ['44da72a8-9527-4802-9cc4-393053913eb9', 'f8df5f46-8a70-40bf-b0cb-9ebe34d3c0f7', 'c4014c1a-a9b2-44d4-9f90-77c355d4560e', '45da1fbe-b40e-495d-b03f-1a94f43711a5'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:40 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] Delete snapshot completed successfully. Jul 04 00:13:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6153abc4-c1dd-483f-9ec8-714d87033ef9 tempest-CinderUnicodeTest-60615541 None] Lock "cinder-96804865-0915-49c5-a8f0-f6ad8e9c026c-delete_snapshot" released by "delete_snapshot" :: held 4.100s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] Acquiring lock "cinder-00bd295d-1651-43fb-9ded-1511db1db949-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] Lock "cinder-00bd295d-1651-43fb-9ded-1511db1db949-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] Acquiring lock "cinder-quobyte-00bd295d-1651-43fb-9ded-1511db1db949" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] Lock "cinder-quobyte-00bd295d-1651-43fb-9ded-1511db1db949" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:40 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d666fe-f2ee-452a-a56e-c0e549c830ee]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:40 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949 Jul 04 00:13:40 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:41 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-e26efd9e-13a7-4a6f-8e0c-611251dd91c1" returned: 0 in 0.801s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] Lock "cinder-quobyte-e26efd9e-13a7-4a6f-8e0c-611251dd91c1" released by "delete_volume" :: held 2.583s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:41 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] Created reservations ['db49f245-0bcd-4a68-a9c6-d8122ebf01bd', '6b08611e-2731-4fc6-ae41-321d04c470bc', 'd290c74f-ab81-4de3-ac69-e76592555cdd', '8f55cb19-95db-47b5-9d40-fbf88bc58b78'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:41 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:13:41 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:42 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.853s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:42 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:13:42 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] Deleted volume successfully. Jul 04 00:13:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-52174a92-f4f7-4eaa-99a6-8cc850c60d13 tempest-VolumeImageDependencyTests-739579268 None] Lock "cinder-e26efd9e-13a7-4a6f-8e0c-611251dd91c1-delete_volume" released by "delete_volume" :: held 3.785s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:42 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949" returned: 0 in 1.263s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:42 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949 Jul 04 00:13:42 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:42 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-00bd295d-1651-43fb-9ded-1511db1db949" returned: 0 in 0.771s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] Lock "cinder-quobyte-00bd295d-1651-43fb-9ded-1511db1db949" released by "delete_volume" :: held 2.114s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:42 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] Created reservations ['c34f6926-59fc-4287-8e58-8cb0fa89f52e', 'd54199c6-7542-46b2-b3e4-b69b7a61d995', 'd29af4d7-eb26-43b3-a563-049bf157c3a9', 'd553aa56-dbe7-47b6-93d5-69ff5aa3dc21'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:43 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:13:43 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (783324d6-9bf6-4316-a17e-b032d9610fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e6e9de-7a35-428a-b86b-4320d7825b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e6e9de-7a35-428a-b86b-4320d7825b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305350726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=381ddf4b-2035-43e4-8d78-6d784c47cddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:13:43Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b91c6431-32ad-434c-98cc-7c46e6b88180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b91c6431-32ad-434c-98cc-7c46e6b88180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be26efba-f017-4b3e-90c2-725331571c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be26efba-f017-4b3e-90c2-725331571c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '381ddf4b-2035-43e4-8d78-6d784c47cddd', 'volume_name': 'volume-381ddf4b-2035-43e4-8d78-6d784c47cddd', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb095c57-72f3-41f5-bdef-5eee0c87648b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb095c57-72f3-41f5-bdef-5eee0c87648b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5382ba06-c426-4aa7-9440-be470b9f52d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:43 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Volume 381ddf4b-2035-43e4-8d78-6d784c47cddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-381ddf4b-2035-43e4-8d78-6d784c47cddd', 'volume_size': 1} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305350726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=381ddf4b-2035-43e4-8d78-6d784c47cddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:13:43Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Creating volume 381ddf4b-2035-43e4-8d78-6d784c47cddd {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:13:43 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:43 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd 1073741824 Jul 04 00:13:43 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:43 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.826s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:13:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] Deleted volume successfully. Jul 04 00:13:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-02202105-f521-44fc-a388-16e49f576dcd tempest-CinderUnicodeTest-60615541 None] Lock "cinder-00bd295d-1651-43fb-9ded-1511db1db949-delete_volume" released by "delete_volume" :: held 3.278s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] Acquiring lock "cinder-15fd9e6d-f490-4bf4-989f-6f2fc11a1717-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] Lock "cinder-15fd9e6d-f490-4bf4-989f-6f2fc11a1717-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] Acquiring lock "cinder-quobyte-15fd9e6d-f490-4bf4-989f-6f2fc11a1717" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] Lock "cinder-quobyte-15fd9e6d-f490-4bf4-989f-6f2fc11a1717" acquired by "delete_volume" :: waited 0.033s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:44 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a749b2-0a89-4c4d-aeba-0bdce3834321]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-15fd9e6d-f490-4bf4-989f-6f2fc11a1717 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:44 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-15fd9e6d-f490-4bf4-989f-6f2fc11a1717 Jul 04 00:13:44 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:45 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd 1073741824" returned: 0 in 1.348s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:45 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd Jul 04 00:13:45 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:45 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-15fd9e6d-f490-4bf4-989f-6f2fc11a1717" returned: 0 in 0.978s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-15fd9e6d-f490-4bf4-989f-6f2fc11a1717 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:45 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-15fd9e6d-f490-4bf4-989f-6f2fc11a1717 Jul 04 00:13:45 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:45 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd" returned: 0 in 0.900s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] <== create_volume: return (2307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:13:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.312s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5382ba06-c426-4aa7-9440-be470b9f52d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-381ddf4b-2035-43e4-8d78-6d784c47cddd', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a62fb6-d88c-4173-b898-5f1ce5446cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:13:46 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Volume volume-381ddf4b-2035-43e4-8d78-6d784c47cddd (381ddf4b-2035-43e4-8d78-6d784c47cddd): created successfully Jul 04 00:13:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a62fb6-d88c-4173-b898-5f1ce5446cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:13:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (783324d6-9bf6-4316-a17e-b032d9610fb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:13:46 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-14ac45cd-4cb7-4390-9ddc-ca832ba3d95f tempest-ProjectMemberTests-119462166 None] Created volume successfully. Jul 04 00:13:46 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-15fd9e6d-f490-4bf4-989f-6f2fc11a1717" returned: 0 in 0.759s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] Lock "cinder-quobyte-15fd9e6d-f490-4bf4-989f-6f2fc11a1717" released by "delete_volume" :: held 1.800s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:46 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] Created reservations ['613a87c8-4dfe-4a54-a47e-3526265a2b76', '02ecc4e9-fdb9-4787-aba3-25d3bb67f877', '0c991a65-0d60-41a0-9599-27061586c486', '7318811e-625e-4423-9f85-3bc315c6f74c'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:13:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:13:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:46 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:13:46 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e7eb8d18-1303-4cd1-a9b8-f250106444d7 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:13:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e7eb8d18-1303-4cd1-a9b8-f250106444d7 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:13:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e7eb8d18-1303-4cd1-a9b8-f250106444d7 tempest-ProjectMemberTests-119462166 None] Creating offline snapshot f864a3f5-f4b8-4ce7-9ea8-b25acb265b38 of volume 381ddf4b-2035-43e4-8d78-6d784c47cddd {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:13:47 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb8f980-1d84-48e3-9e75-005cf5ff980e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7eb8d18-1303-4cd1-a9b8-f250106444d7 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:47 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd Jul 04 00:13:47 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:47 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.181s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:47 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:13:47 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] Deleted volume successfully. Jul 04 00:13:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-311685f7-4a9e-41dc-9323-242a4b6e90b7 tempest-CinderUnicodeTest-60615541 None] Lock "cinder-15fd9e6d-f490-4bf4-989f-6f2fc11a1717-delete_volume" released by "delete_volume" :: held 3.351s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:48 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7eb8d18-1303-4cd1-a9b8-f250106444d7 tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd" returned: 0 in 0.985s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7eb8d18-1303-4cd1-a9b8-f250106444d7 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:48 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38 1G Jul 04 00:13:48 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:49 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7eb8d18-1303-4cd1-a9b8-f250106444d7 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38 1G" returned: 0 in 0.998s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7eb8d18-1303-4cd1-a9b8-f250106444d7 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-381ddf4b-2035-43e4-8d78-6d784c47cddd -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:49 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-381ddf4b-2035-43e4-8d78-6d784c47cddd -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38 Jul 04 00:13:49 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:50 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7eb8d18-1303-4cd1-a9b8-f250106444d7 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-381ddf4b-2035-43e4-8d78-6d784c47cddd -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38" returned: 0 in 0.799s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:50 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-e7eb8d18-1303-4cd1-a9b8-f250106444d7 tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38 is being set with open permissions: ugo+rw Jul 04 00:13:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7eb8d18-1303-4cd1-a9b8-f250106444d7 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:50 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38 Jul 04 00:13:50 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:50 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7eb8d18-1303-4cd1-a9b8-f250106444d7 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38" returned: 0 in 0.708s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7eb8d18-1303-4cd1-a9b8-f250106444d7 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:50 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.info Jul 04 00:13:50 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:51 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7eb8d18-1303-4cd1-a9b8-f250106444d7 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.info" returned: 0 in 0.809s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:51 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-e7eb8d18-1303-4cd1-a9b8-f250106444d7 tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.info is being set with open permissions: ugo+rw Jul 04 00:13:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7eb8d18-1303-4cd1-a9b8-f250106444d7 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:51 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.info Jul 04 00:13:51 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-58155dbe-43ad-4e85-811b-17e0b5ccdc0d tempest-ProjectAdminTests-635738190 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86676) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Jul 04 00:13:52 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e7eb8d18-1303-4cd1-a9b8-f250106444d7 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.info" returned: 0 in 0.755s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e7eb8d18-1303-4cd1-a9b8-f250106444d7 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.225s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:13:52 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e7eb8d18-1303-4cd1-a9b8-f250106444d7 tempest-ProjectMemberTests-119462166 None] Create snapshot completed successfully Jul 04 00:13:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-f864a3f5-f4b8-4ce7-9ea8-b25acb265b38-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] Lock "cinder-f864a3f5-f4b8-4ce7-9ea8-b25acb265b38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-381ddf4b-2035-43e4-8d78-6d784c47cddd" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-381ddf4b-2035-43e4-8d78-6d784c47cddd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-f864a3f5-f4b8-4ce7-9ea8-b25acb265b38" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-f864a3f5-f4b8-4ce7-9ea8-b25acb265b38" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] Deleting offline snapshot f864a3f5-f4b8-4ce7-9ea8-b25acb265b38 of volume 381ddf4b-2035-43e4-8d78-6d784c47cddd {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:13:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] snapshot_file for this snap is: volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:13:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed196f5-b2e9-4c27-9ea4-5a1efc3871df]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:53 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38 Jul 04 00:13:53 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:54 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38" returned: 0 in 0.832s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-381ddf4b-2035-43e4-8d78-6d784c47cddd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:13:54 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[721a3019-0671-43c2-857a-3149b5350399]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:54 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd Jul 04 00:13:54 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:55 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd" returned: 0 in 0.957s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:55 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38 Jul 04 00:13:55 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:56 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38" returned: 0 in 0.905s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:56 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38 Jul 04 00:13:56 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:57 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd.f864a3f5-f4b8-4ce7-9ea8-b25acb265b38" returned: 0 in 0.885s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-f864a3f5-f4b8-4ce7-9ea8-b25acb265b38" released by "_delete_snapshot" :: held 3.733s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-381ddf4b-2035-43e4-8d78-6d784c47cddd" released by "delete_snapshot" :: held 3.774s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:57 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] Created reservations ['aed83ed3-d094-42a8-bf59-6f37043cd813', '88e01cc2-1030-4509-b024-f6a34214464f', 'a776295e-12fb-4858-91e6-c79661683b4d', '6d0b3f1d-a5a8-401e-8e08-5bdbaef2d1f4'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:13:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] Delete snapshot completed successfully. Jul 04 00:13:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9604c26c-0f03-4600-a4aa-e2bf81a44bfc tempest-ProjectMemberTests-119462166 None] Lock "cinder-f864a3f5-f4b8-4ce7-9ea8-b25acb265b38-delete_snapshot" released by "delete_snapshot" :: held 4.121s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:13:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-381ddf4b-2035-43e4-8d78-6d784c47cddd-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] Lock "cinder-381ddf4b-2035-43e4-8d78-6d784c47cddd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-381ddf4b-2035-43e4-8d78-6d784c47cddd" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:13:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-381ddf4b-2035-43e4-8d78-6d784c47cddd" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:13:58 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e9e160-3296-4d87-bcbc-66dc9e97a496]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:13:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:58 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd Jul 04 00:13:58 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:13:59 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 04 00:13:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd" returned: 0 in 1.177s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:13:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:13:59 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd Jul 04 00:13:59 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:00 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-381ddf4b-2035-43e4-8d78-6d784c47cddd" returned: 0 in 0.938s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-381ddf4b-2035-43e4-8d78-6d784c47cddd" released by "delete_volume" :: held 2.216s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:00 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] Created reservations ['e888ad7c-ab9d-4023-9f60-13c0b95a1160', 'c8d096ec-6422-405d-922a-c6a2d3a4785f', '4a9abec4-be2d-4e0d-ae77-f9dac5d668d5', '8757f459-8ea1-48ed-80a1-6a7611b63236'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:14:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:00 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:14:00 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:01 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.953s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:01 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:14:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] Deleted volume successfully. Jul 04 00:14:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5e0263d7-9337-4af6-905d-43c2ab70582f tempest-ProjectMemberTests-119462166 None] Lock "cinder-381ddf4b-2035-43e4-8d78-6d784c47cddd-delete_volume" released by "delete_volume" :: held 3.514s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:01 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:14:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Flow 'volume_create_manager' (1e762662-a6c4-4402-815f-8b928440992b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a052deb-da8d-4968-b01d-209318735821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a052deb-da8d-4968-b01d-209318735821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708432149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b28a6c-51f7-4679-8d1b-100731a04796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3921c0b818405fbee8b241596fa806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:02Z,use_quota=True,user_id='41092cc2717d43a9a6a76e9cd0f386bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8d32b5-07d8-41bc-aedb-4e5fa9cf9844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8d32b5-07d8-41bc-aedb-4e5fa9cf9844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07aad548-e97d-4dbf-aa8f-9949eb41c45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07aad548-e97d-4dbf-aa8f-9949eb41c45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b28a6c-51f7-4679-8d1b-100731a04796', 'volume_name': 'volume-48b28a6c-51f7-4679-8d1b-100731a04796', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6403dea-adc4-4f2d-8357-7694d9a88f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6403dea-adc4-4f2d-8357-7694d9a88f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51153fe5-1acb-4739-a980-6bbdfb1592d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:02 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Volume 48b28a6c-51f7-4679-8d1b-100731a04796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b28a6c-51f7-4679-8d1b-100731a04796', 'volume_size': 1} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708432149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b28a6c-51f7-4679-8d1b-100731a04796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3921c0b818405fbee8b241596fa806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:02Z,use_quota=True,user_id='41092cc2717d43a9a6a76e9cd0f386bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Creating volume 48b28a6c-51f7-4679-8d1b-100731a04796 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:14:02 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:02 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796 1073741824 Jul 04 00:14:02 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (2a4f4fce-c483-4cc8-a7b2-e652fee85ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe958112-bbb5-4b00-911c-a328cf46f2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe958112-bbb5-4b00-911c-a328cf46f2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-329487545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c5164d-8e35-4324-9f4f-3beddabdcbc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:02Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8cc0426-6418-4a96-897b-77402bd9dc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8cc0426-6418-4a96-897b-77402bd9dc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9ff453-95b4-46b7-8fd6-6fb7ea2b209f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9ff453-95b4-46b7-8fd6-6fb7ea2b209f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83c5164d-8e35-4324-9f4f-3beddabdcbc2', 'volume_name': 'volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f624c85d-759f-48dd-8085-9c980dd5596d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f624c85d-759f-48dd-8085-9c980dd5596d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b0a97d-6d58-4ed5-b2a2-68d3a5d97924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:02 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Volume 83c5164d-8e35-4324-9f4f-3beddabdcbc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2', 'volume_size': 1} Jul 04 00:14:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:03 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796 1073741824" returned: 0 in 1.294s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:03 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796 Jul 04 00:14:03 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:04 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796" returned: 0 in 0.803s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:14:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.638s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-329487545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c5164d-8e35-4324-9f4f-3beddabdcbc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:02Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:14:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Creating volume 83c5164d-8e35-4324-9f4f-3beddabdcbc2 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:14:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:14:04 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:14:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:04 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2 1073741824 Jul 04 00:14:04 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51153fe5-1acb-4739-a980-6bbdfb1592d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b28a6c-51f7-4679-8d1b-100731a04796', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a55bcc-5732-47ea-8b8f-4a08f4e1f784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:04 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Volume volume-48b28a6c-51f7-4679-8d1b-100731a04796 (48b28a6c-51f7-4679-8d1b-100731a04796): created successfully Jul 04 00:14:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a55bcc-5732-47ea-8b8f-4a08f4e1f784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Flow 'volume_create_manager' (1e762662-a6c4-4402-815f-8b928440992b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6ea7003b-97af-4ff9-8cde-d3d8ccc84c6e tempest-ProjectReaderTests-1636517028 None] Created volume successfully. Jul 04 00:14:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2 1073741824" returned: 0 in 1.033s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:05 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:05 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2 Jul 04 00:14:05 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-39688c41-32dc-4ec0-8862-aae6dd2ddb3c tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:06 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2" returned: 0 in 0.705s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:14:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-39688c41-32dc-4ec0-8862-aae6dd2ddb3c tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.644s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-39688c41-32dc-4ec0-8862-aae6dd2ddb3c tempest-ProjectReaderTests-1636517028 None] Creating offline snapshot c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3 of volume 48b28a6c-51f7-4679-8d1b-100731a04796 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:14:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b0a97d-6d58-4ed5-b2a2-68d3a5d97924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb77ebc2-e9fc-432d-b194-5864cd9c684a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:06 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b16ad8-b46d-46df-b1da-de2991ec20cb]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39688c41-32dc-4ec0-8862-aae6dd2ddb3c tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:06 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Volume volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2 (83c5164d-8e35-4324-9f4f-3beddabdcbc2): created successfully Jul 04 00:14:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb77ebc2-e9fc-432d-b194-5864cd9c684a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (2a4f4fce-c483-4cc8-a7b2-e652fee85ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:06 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fb01deaa-7212-4492-9ca2-1e77dd1bf142 tempest-ProjectMemberTests-119462166 None] Created volume successfully. Jul 04 00:14:06 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796 Jul 04 00:14:06 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a396833-4c01-48c9-9854-00b38fa38132 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:07 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39688c41-32dc-4ec0-8862-aae6dd2ddb3c tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796" returned: 0 in 1.203s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39688c41-32dc-4ec0-8862-aae6dd2ddb3c tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:07 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3 1G Jul 04 00:14:07 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:08 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39688c41-32dc-4ec0-8862-aae6dd2ddb3c tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3 1G" returned: 0 in 1.017s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39688c41-32dc-4ec0-8862-aae6dd2ddb3c tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48b28a6c-51f7-4679-8d1b-100731a04796 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:08 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48b28a6c-51f7-4679-8d1b-100731a04796 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3 Jul 04 00:14:08 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:09 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39688c41-32dc-4ec0-8862-aae6dd2ddb3c tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48b28a6c-51f7-4679-8d1b-100731a04796 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3" returned: 0 in 0.758s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:09 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-39688c41-32dc-4ec0-8862-aae6dd2ddb3c tempest-ProjectReaderTests-1636517028 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3 is being set with open permissions: ugo+rw Jul 04 00:14:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39688c41-32dc-4ec0-8862-aae6dd2ddb3c tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:09 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3 Jul 04 00:14:09 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:09 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:14:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Flow 'volume_create_manager' (2e5d9e85-1d46-4abf-b338-1fbc234e59de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea249fac-86fc-4e44-963b-604536234a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea249fac-86fc-4e44-963b-604536234a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-40868451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66544618-544f-48cb-82b4-4b1207b1e08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f231693e054b99979c595c4b3330f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:09Z,use_quota=True,user_id='5782e063f3004712b1e3f25076d532bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db32e2dd-8306-4c96-a55a-e35b902d8c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db32e2dd-8306-4c96-a55a-e35b902d8c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e8d51f-ca85-45bc-b1be-59bcce874937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e8d51f-ca85-45bc-b1be-59bcce874937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66544618-544f-48cb-82b4-4b1207b1e08f', 'volume_name': 'volume-66544618-544f-48cb-82b4-4b1207b1e08f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b830dfc-e255-4f22-8dd6-3dc1ae4f41b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b830dfc-e255-4f22-8dd6-3dc1ae4f41b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aefb61a9-d02c-4f5e-9337-88e07787173b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:09 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Volume 66544618-544f-48cb-82b4-4b1207b1e08f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66544618-544f-48cb-82b4-4b1207b1e08f', 'volume_size': 1} Jul 04 00:14:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:09 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39688c41-32dc-4ec0-8862-aae6dd2ddb3c tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3" returned: 0 in 0.731s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39688c41-32dc-4ec0-8862-aae6dd2ddb3c tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:09 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.info Jul 04 00:14:09 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:10 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39688c41-32dc-4ec0-8862-aae6dd2ddb3c tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.info" returned: 0 in 0.851s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:10 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-39688c41-32dc-4ec0-8862-aae6dd2ddb3c tempest-ProjectReaderTests-1636517028 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.info is being set with open permissions: ugo+rw Jul 04 00:14:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39688c41-32dc-4ec0-8862-aae6dd2ddb3c tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:10 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.info Jul 04 00:14:10 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:11 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39688c41-32dc-4ec0-8862-aae6dd2ddb3c tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.info" returned: 0 in 0.728s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-39688c41-32dc-4ec0-8862-aae6dd2ddb3c tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.399s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a396833-4c01-48c9-9854-00b38fa38132 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.612s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-2a396833-4c01-48c9-9854-00b38fa38132 tempest-ProjectMemberTests-119462166 None] Creating offline snapshot 15393744-ea7a-4cd0-b567-bde876b67e62 of volume 83c5164d-8e35-4324-9f4f-3beddabdcbc2 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:14:11 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-39688c41-32dc-4ec0-8862-aae6dd2ddb3c tempest-ProjectReaderTests-1636517028 None] Create snapshot completed successfully Jul 04 00:14:11 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7191638-d855-46fd-be10-38959be3a944]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a396833-4c01-48c9-9854-00b38fa38132 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:11 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2 Jul 04 00:14:11 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-quobyte-48b28a6c-51f7-4679-8d1b-100731a04796" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-48b28a6c-51f7-4679-8d1b-100731a04796" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-quobyte-c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] Deleting offline snapshot c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3 of volume 48b28a6c-51f7-4679-8d1b-100731a04796 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:14:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] snapshot_file for this snap is: volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:14:12 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[39736f6d-b719-4e0d-914f-f667ee4c3941]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:12 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3 Jul 04 00:14:12 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:12 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a396833-4c01-48c9-9854-00b38fa38132 tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2" returned: 0 in 0.999s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a396833-4c01-48c9-9854-00b38fa38132 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:12 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62 1G Jul 04 00:14:12 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:12 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3" returned: 0 in 0.894s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48b28a6c-51f7-4679-8d1b-100731a04796(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:14:12 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4111400-9dcc-4873-be43-1e957058e422]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:13 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796 Jul 04 00:14:13 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a396833-4c01-48c9-9854-00b38fa38132 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62 1G" returned: 0 in 0.950s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a396833-4c01-48c9-9854-00b38fa38132 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:13 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:13 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62 Jul 04 00:14:13 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:13 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796" returned: 0 in 0.812s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:13 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3 Jul 04 00:14:13 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:14 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a396833-4c01-48c9-9854-00b38fa38132 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62" returned: 0 in 0.734s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:14 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-2a396833-4c01-48c9-9854-00b38fa38132 tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62 is being set with open permissions: ugo+rw Jul 04 00:14:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a396833-4c01-48c9-9854-00b38fa38132 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:14 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62 Jul 04 00:14:14 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:14 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3" returned: 0 in 0.832s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:14 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3 Jul 04 00:14:14 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:14 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a396833-4c01-48c9-9854-00b38fa38132 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62" returned: 0 in 0.733s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a396833-4c01-48c9-9854-00b38fa38132 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:14 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.info Jul 04 00:14:14 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:15 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796.c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3" returned: 0 in 0.843s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3" released by "_delete_snapshot" :: held 3.529s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-48b28a6c-51f7-4679-8d1b-100731a04796" released by "delete_snapshot" :: held 3.557s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:15 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] Created reservations ['cd948b2d-2a4b-4778-9f9e-e4c8b5397a10', 'dcbe9f85-b084-447d-971d-0bad47cc3dbb', '1dad3402-7a7b-4e9b-8ce1-399f43ba1032', '715f2ec6-e19a-4b0d-a4ee-a9d92d8a1a2d'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:14:15 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a396833-4c01-48c9-9854-00b38fa38132 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.info" returned: 0 in 0.751s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:15 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-2a396833-4c01-48c9-9854-00b38fa38132 tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.info is being set with open permissions: ugo+rw Jul 04 00:14:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a396833-4c01-48c9-9854-00b38fa38132 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:15 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] Delete snapshot completed successfully. Jul 04 00:14:15 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.info Jul 04 00:14:15 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-524a07c8-17ff-4903-a271-d95b96d6c030 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-c7890f26-dcfb-4a5c-b3b0-d4bf0e8ef7f3-delete_snapshot" released by "delete_snapshot" :: held 3.754s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Flow 'volume_create_manager' (53df85a8-1f63-42b8-b407-44872709fc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d17793e-13be-4e7a-ad63-4b5522d78123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d17793e-13be-4e7a-ad63-4b5522d78123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1060859917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18411804-f29c-423d-8cf6-f4209a3954a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f725e825cb4ea8804af086c6ff6a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:16Z,use_quota=True,user_id='a1ce31b7ec2345808b1d633c400e574d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46429322-d8af-4228-b160-4b74a1723a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46429322-d8af-4228-b160-4b74a1723a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000b329a-dac5-471e-82d7-9e94e86ffa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000b329a-dac5-471e-82d7-9e94e86ffa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18411804-f29c-423d-8cf6-f4209a3954a7', 'volume_name': 'volume-18411804-f29c-423d-8cf6-f4209a3954a7', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d54af3-55fd-4e26-87fb-fc49ec517a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d54af3-55fd-4e26-87fb-fc49ec517a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d103f544-e011-4e59-b35a-d04c8ff45cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:16 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Volume 18411804-f29c-423d-8cf6-f4209a3954a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18411804-f29c-423d-8cf6-f4209a3954a7', 'volume_size': 1} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-48b28a6c-51f7-4679-8d1b-100731a04796-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] Lock "cinder-48b28a6c-51f7-4679-8d1b-100731a04796-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-quobyte-48b28a6c-51f7-4679-8d1b-100731a04796" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-48b28a6c-51f7-4679-8d1b-100731a04796" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[979b3756-925c-43f2-909f-50ca848ca3fd]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:16 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a396833-4c01-48c9-9854-00b38fa38132 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.info" returned: 0 in 0.690s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a396833-4c01-48c9-9854-00b38fa38132 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.973s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.786s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-40868451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66544618-544f-48cb-82b4-4b1207b1e08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f231693e054b99979c595c4b3330f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:09Z,use_quota=True,user_id='5782e063f3004712b1e3f25076d532bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Creating volume 66544618-544f-48cb-82b4-4b1207b1e08f {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:14:16 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:14:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66544618-544f-48cb-82b4-4b1207b1e08f 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:16 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66544618-544f-48cb-82b4-4b1207b1e08f 1073741824 Jul 04 00:14:16 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:16 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796 Jul 04 00:14:16 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2a396833-4c01-48c9-9854-00b38fa38132 tempest-ProjectMemberTests-119462166 None] Create snapshot completed successfully Jul 04 00:14:17 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796" returned: 0 in 0.738s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:17 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796 Jul 04 00:14:17 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-15393744-ea7a-4cd0-b567-bde876b67e62-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] Lock "cinder-15393744-ea7a-4cd0-b567-bde876b67e62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-83c5164d-8e35-4324-9f4f-3beddabdcbc2" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-83c5164d-8e35-4324-9f4f-3beddabdcbc2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-15393744-ea7a-4cd0-b567-bde876b67e62" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-15393744-ea7a-4cd0-b567-bde876b67e62" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:17 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] Deleting offline snapshot 15393744-ea7a-4cd0-b567-bde876b67e62 of volume 83c5164d-8e35-4324-9f4f-3beddabdcbc2 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] snapshot_file for this snap is: volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66544618-544f-48cb-82b4-4b1207b1e08f 1073741824" returned: 0 in 0.903s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b85251-6b5c-49fa-96c7-7de43b6bef40]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66544618-544f-48cb-82b4-4b1207b1e08f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:17 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66544618-544f-48cb-82b4-4b1207b1e08f Jul 04 00:14:17 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:17 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62 Jul 04 00:14:17 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:17 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-48b28a6c-51f7-4679-8d1b-100731a04796" returned: 0 in 0.657s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-48b28a6c-51f7-4679-8d1b-100731a04796" released by "delete_volume" :: held 1.467s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] Created reservations ['7aa6e1c6-311e-4879-b97f-6158a9741308', '99f43790-0539-4e7f-9db0-c0782d226ff2', '1c2baf32-3cf6-4d2c-8d75-a940cb91dced', '311adb4c-c979-4a0d-9be6-211c9d18a45f'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:17 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:14:17 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:18 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66544618-544f-48cb-82b4-4b1207b1e08f" returned: 0 in 0.677s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.932s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1060859917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18411804-f29c-423d-8cf6-f4209a3954a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f725e825cb4ea8804af086c6ff6a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:16Z,use_quota=True,user_id='a1ce31b7ec2345808b1d633c400e574d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Creating volume 18411804-f29c-423d-8cf6-f4209a3954a7 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:14:18 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aefb61a9-d02c-4f5e-9337-88e07787173b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66544618-544f-48cb-82b4-4b1207b1e08f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:18 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 1073741824 Jul 04 00:14:18 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2507df0-20cc-4bb1-acc5-a59db9d123c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:18 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Volume volume-66544618-544f-48cb-82b4-4b1207b1e08f (66544618-544f-48cb-82b4-4b1207b1e08f): created successfully Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2507df0-20cc-4bb1-acc5-a59db9d123c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:18 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Flow 'volume_create_manager' (2e5d9e85-1d46-4abf-b338-1fbc234e59de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62" returned: 0 in 0.815s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:14:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-aca7c509-1d04-46ae-83b3-95fb8437c1dd tempest-ProjectReaderTests-918048902 None] Created volume successfully. Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bb0f33-15a1-4f75-b0f3-34d8ff1f0b55]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:18 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2 Jul 04 00:14:18 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:18 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.756s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:14:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] Deleted volume successfully. Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8ef16bba-c3b3-4147-8da9-429031c1affe tempest-ProjectReaderTests-1636517028 None] Lock "cinder-48b28a6c-51f7-4679-8d1b-100731a04796-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Flow 'volume_create_manager' (2770fa29-e9ac-478c-bbbd-54145a7c3f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a5870f-f11c-447a-8c1f-0b1227afe8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:18 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a5870f-f11c-447a-8c1f-0b1227afe8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1220638302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74684871-ff11-4a8a-bdc9-76829f8bbc83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3921c0b818405fbee8b241596fa806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:19Z,use_quota=True,user_id='41092cc2717d43a9a6a76e9cd0f386bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef8c958-f2fa-4354-bebd-2482ee6b1f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef8c958-f2fa-4354-bebd-2482ee6b1f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed436c6d-ddda-4a5d-be6a-7f113adcf1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed436c6d-ddda-4a5d-be6a-7f113adcf1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74684871-ff11-4a8a-bdc9-76829f8bbc83', 'volume_name': 'volume-74684871-ff11-4a8a-bdc9-76829f8bbc83', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ca02e4-9381-47db-913d-5e79dcc3d040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:19 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ca02e4-9381-47db-913d-5e79dcc3d040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1463c5d2-81bc-4ed2-af0a-ee5708818f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:19 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Volume 74684871-ff11-4a8a-bdc9-76829f8bbc83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74684871-ff11-4a8a-bdc9-76829f8bbc83', 'volume_size': 1} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 1073741824" returned: 0 in 0.968s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2" returned: 0 in 0.849s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:19 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62 Jul 04 00:14:19 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:19 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 Jul 04 00:14:19 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] Acquiring lock "cinder-66544618-544f-48cb-82b4-4b1207b1e08f-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] Lock "cinder-66544618-544f-48cb-82b4-4b1207b1e08f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] Acquiring lock "cinder-quobyte-66544618-544f-48cb-82b4-4b1207b1e08f" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] Lock "cinder-quobyte-66544618-544f-48cb-82b4-4b1207b1e08f" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[527a7706-9673-407e-8c1e-d07a6f3e0a40]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66544618-544f-48cb-82b4-4b1207b1e08f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:19 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66544618-544f-48cb-82b4-4b1207b1e08f Jul 04 00:14:19 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:19 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7" returned: 0 in 0.668s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.728s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1220638302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74684871-ff11-4a8a-bdc9-76829f8bbc83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3921c0b818405fbee8b241596fa806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:19Z,use_quota=True,user_id='41092cc2717d43a9a6a76e9cd0f386bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Creating volume 74684871-ff11-4a8a-bdc9-76829f8bbc83 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:14:19 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:19 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83 1073741824 Jul 04 00:14:19 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d103f544-e011-4e59-b35a-d04c8ff45cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18411804-f29c-423d-8cf6-f4209a3954a7', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1294b27a-2362-4fff-9582-78fa4f784730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:19 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Volume volume-18411804-f29c-423d-8cf6-f4209a3954a7 (18411804-f29c-423d-8cf6-f4209a3954a7): created successfully Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1294b27a-2362-4fff-9582-78fa4f784730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Flow 'volume_create_manager' (53df85a8-1f63-42b8-b407-44872709fc27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:19 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62" returned: 0 in 0.817s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:19 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e6187d00-65f9-482a-a906-07d595de4a17 tempest-SnapshotDependencyTests-1912991502 None] Created volume successfully. Jul 04 00:14:19 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62 Jul 04 00:14:19 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66544618-544f-48cb-82b4-4b1207b1e08f" returned: 0 in 1.007s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:20 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66544618-544f-48cb-82b4-4b1207b1e08f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-64521faa-bdf0-455a-bdf6-11b194c75be3 tempest-SnapshotDependencyTests-1912991502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:20 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66544618-544f-48cb-82b4-4b1207b1e08f Jul 04 00:14:20 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:20 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2.15393744-ea7a-4cd0-b567-bde876b67e62" returned: 0 in 0.949s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-15393744-ea7a-4cd0-b567-bde876b67e62" released by "_delete_snapshot" :: held 3.580s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-83c5164d-8e35-4324-9f4f-3beddabdcbc2" released by "delete_snapshot" :: held 3.607s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:20 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83 1073741824" returned: 0 in 1.108s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:20 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83 Jul 04 00:14:20 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:20 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] Created reservations ['a51e2a12-3f31-4703-a88e-4c3792210094', '111122b5-cd4b-476e-b438-91131c323772', '53d40b8e-1103-4b4e-8ebb-4190fec786bb', '254935f7-8361-46e6-a147-c02318386297'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:14:21 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] Delete snapshot completed successfully. Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-48830a9c-c5ae-4450-9b9a-60bc75bb0d25 tempest-ProjectMemberTests-119462166 None] Lock "cinder-15393744-ea7a-4cd0-b567-bde876b67e62-delete_snapshot" released by "delete_snapshot" :: held 3.796s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:21 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-66544618-544f-48cb-82b4-4b1207b1e08f" returned: 0 in 0.736s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] Lock "cinder-quobyte-66544618-544f-48cb-82b4-4b1207b1e08f" released by "delete_volume" :: held 1.799s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] Created reservations ['22a948c8-3a92-475a-a93b-ee3e03796dc8', 'b3a2c75d-b0ee-4fe5-8840-cb916df876e0', '51f52d5e-17a1-42c7-92e5-f5d9425b73c3', '7ad39f92-e1d1-4ebb-944b-e5f6e2928200'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:21 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:14:21 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-83c5164d-8e35-4324-9f4f-3beddabdcbc2-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] Lock "cinder-83c5164d-8e35-4324-9f4f-3beddabdcbc2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-83c5164d-8e35-4324-9f4f-3beddabdcbc2" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:21 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83" returned: 0 in 0.720s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-64521faa-bdf0-455a-bdf6-11b194c75be3 tempest-SnapshotDependencyTests-1912991502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.034s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-83c5164d-8e35-4324-9f4f-3beddabdcbc2" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-64521faa-bdf0-455a-bdf6-11b194c75be3 tempest-SnapshotDependencyTests-1912991502 None] Creating offline snapshot c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 of volume 18411804-f29c-423d-8cf6-f4209a3954a7 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[913e2728-08d6-40c8-9423-122885bda42f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1463c5d2-81bc-4ed2-af0a-ee5708818f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74684871-ff11-4a8a-bdc9-76829f8bbc83', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e61a52-b66a-443a-b185-d5257dd2ff0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5764e3be-fc48-472d-8589-85ad424c7927]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64521faa-bdf0-455a-bdf6-11b194c75be3 tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:21 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Volume volume-74684871-ff11-4a8a-bdc9-76829f8bbc83 (74684871-ff11-4a8a-bdc9-76829f8bbc83): created successfully Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e61a52-b66a-443a-b185-d5257dd2ff0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Flow 'volume_create_manager' (2770fa29-e9ac-478c-bbbd-54145a7c3f13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:21 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-cacf2a85-e7e2-4753-a861-78b289ff4cfa tempest-ProjectReaderTests-1636517028 None] Created volume successfully. Jul 04 00:14:21 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2 Jul 04 00:14:21 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:21 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 Jul 04 00:14:21 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:22 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.946s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:14:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] Deleted volume successfully. Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f6ef0f63-94d0-405b-bbf1-8072a01a556a tempest-ProjectReaderTests-918048902 None] Lock "cinder-66544618-544f-48cb-82b4-4b1207b1e08f-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-591a189d-1ade-40f7-9ef5-60d6bb5a7df9 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Flow 'volume_create_manager' (b9b96009-af3e-4a5a-9920-a9f51f0ecead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dadab6d-e640-41fb-9b50-1ae43bd5388d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dadab6d-e640-41fb-9b50-1ae43bd5388d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-497484266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7fe8c64-2354-4808-accb-e87fb40e6523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f231693e054b99979c595c4b3330f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:23Z,use_quota=True,user_id='5782e063f3004712b1e3f25076d532bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419d86c6-9c08-4a7b-81cd-378cc08ffd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419d86c6-9c08-4a7b-81cd-378cc08ffd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843af300-43c9-43ef-ba50-84f7a8999ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843af300-43c9-43ef-ba50-84f7a8999ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7fe8c64-2354-4808-accb-e87fb40e6523', 'volume_name': 'volume-f7fe8c64-2354-4808-accb-e87fb40e6523', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ddebe3-63fc-4ebb-944f-75566ef68d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ddebe3-63fc-4ebb-944f-75566ef68d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f45f785-3f7b-4a51-bcf5-9ba0baf6b21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:22 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Volume f7fe8c64-2354-4808-accb-e87fb40e6523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7fe8c64-2354-4808-accb-e87fb40e6523', 'volume_size': 1} Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:22 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2" returned: 0 in 1.013s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:22 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2 Jul 04 00:14:22 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:22 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64521faa-bdf0-455a-bdf6-11b194c75be3 tempest-SnapshotDependencyTests-1912991502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7" returned: 0 in 1.050s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64521faa-bdf0-455a-bdf6-11b194c75be3 tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:22 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 1G Jul 04 00:14:22 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:23 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-83c5164d-8e35-4324-9f4f-3beddabdcbc2" returned: 0 in 0.659s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-83c5164d-8e35-4324-9f4f-3beddabdcbc2" released by "delete_volume" :: held 1.758s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:23 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] Created reservations ['cd6ce31e-137a-436f-af22-4bd5353d3b77', '2571a13d-8469-45fb-8d14-ec033213fca1', '24dd7a49-462d-4749-891f-7cc30be172ca', '13cc6420-887c-473a-9ff0-e8c411543b9b'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:14:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:23 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:14:23 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:23 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64521faa-bdf0-455a-bdf6-11b194c75be3 tempest-SnapshotDependencyTests-1912991502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 1G" returned: 0 in 0.872s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64521faa-bdf0-455a-bdf6-11b194c75be3 tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18411804-f29c-423d-8cf6-f4209a3954a7 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:23 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18411804-f29c-423d-8cf6-f4209a3954a7 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 Jul 04 00:14:23 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:24 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.687s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:24 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:14:24 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] Deleted volume successfully. Jul 04 00:14:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5816b1eb-fdd1-4cb3-a4cf-9d2641049375 tempest-ProjectMemberTests-119462166 None] Lock "cinder-83c5164d-8e35-4324-9f4f-3beddabdcbc2-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:24 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:14:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (017685d1-d35e-43e8-8cb2-dcf33a543308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baaacddb-967d-4abf-af03-a8341da86964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baaacddb-967d-4abf-af03-a8341da86964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1518093641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83d3e15-819c-4371-b14a-ba2799362bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:24Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3289ee-4dc6-4d9e-8fc4-1c3749584aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3289ee-4dc6-4d9e-8fc4-1c3749584aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ccff77-1254-48f3-baf1-2e5a02ee5412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ccff77-1254-48f3-baf1-2e5a02ee5412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b83d3e15-819c-4371-b14a-ba2799362bb1', 'volume_name': 'volume-b83d3e15-819c-4371-b14a-ba2799362bb1', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6afc0fc-0957-4796-ad35-0c967c6a5922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:24 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6afc0fc-0957-4796-ad35-0c967c6a5922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a04bf88-afa0-48e2-9655-755a9f8761c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:24 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Volume b83d3e15-819c-4371-b14a-ba2799362bb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b83d3e15-819c-4371-b14a-ba2799362bb1', 'volume_size': 1} Jul 04 00:14:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64521faa-bdf0-455a-bdf6-11b194c75be3 tempest-SnapshotDependencyTests-1912991502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18411804-f29c-423d-8cf6-f4209a3954a7 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9" returned: 0 in 0.756s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:24 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-64521faa-bdf0-455a-bdf6-11b194c75be3 tempest-SnapshotDependencyTests-1912991502 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 is being set with open permissions: ugo+rw Jul 04 00:14:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64521faa-bdf0-455a-bdf6-11b194c75be3 tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:24 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 Jul 04 00:14:24 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:25 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64521faa-bdf0-455a-bdf6-11b194c75be3 tempest-SnapshotDependencyTests-1912991502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9" returned: 0 in 0.610s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64521faa-bdf0-455a-bdf6-11b194c75be3 tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:25 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.info Jul 04 00:14:25 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:25 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64521faa-bdf0-455a-bdf6-11b194c75be3 tempest-SnapshotDependencyTests-1912991502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.info" returned: 0 in 0.722s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:25 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-64521faa-bdf0-455a-bdf6-11b194c75be3 tempest-SnapshotDependencyTests-1912991502 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.info is being set with open permissions: ugo+rw Jul 04 00:14:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64521faa-bdf0-455a-bdf6-11b194c75be3 tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:25 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.info Jul 04 00:14:25 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:26 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64521faa-bdf0-455a-bdf6-11b194c75be3 tempest-SnapshotDependencyTests-1912991502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.info" returned: 0 in 0.604s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-64521faa-bdf0-455a-bdf6-11b194c75be3 tempest-SnapshotDependencyTests-1912991502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.758s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-591a189d-1ade-40f7-9ef5-60d6bb5a7df9 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.826s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-591a189d-1ade-40f7-9ef5-60d6bb5a7df9 tempest-ProjectReaderTests-1636517028 None] Creating offline snapshot 46acd052-074e-443d-ac7a-7e0d60e27084 of volume 74684871-ff11-4a8a-bdc9-76829f8bbc83 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:14:26 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-64521faa-bdf0-455a-bdf6-11b194c75be3 tempest-SnapshotDependencyTests-1912991502 None] Create snapshot completed successfully Jul 04 00:14:26 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbfa674-ae62-4d2a-b1c0-43d27475d054]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-591a189d-1ade-40f7-9ef5-60d6bb5a7df9 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:26 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83 Jul 04 00:14:26 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:27 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-591a189d-1ade-40f7-9ef5-60d6bb5a7df9 tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83" returned: 0 in 0.754s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-591a189d-1ade-40f7-9ef5-60d6bb5a7df9 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:27 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084 1G Jul 04 00:14:27 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:27 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=127,cinder:UPDATE=150,cinder:INSERT=37,cinder:DELETE=11 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:14:27 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=146,cinder:DELETE=13,cinder:SELECT=112,cinder:INSERT=48 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:14:27 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:14:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Flow 'volume_create_manager' (965f0a3e-7fbf-49b0-9160-bf57db14ac2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebaded8-6b6e-4b75-9a61-ec0bc011ec94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebaded8-6b6e-4b75-9a61-ec0bc011ec94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5aaa9a2-c5c6-4043-b18b-adaba202465f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f725e825cb4ea8804af086c6ff6a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c2aade1a-7fcb-4678-b9bb-dd71a037a5d9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:27Z,use_quota=True,user_id='a1ce31b7ec2345808b1d633c400e574d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c17d3b-59c2-4df5-ba13-f3fa4c4ed854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c17d3b-59c2-4df5-ba13-f3fa4c4ed854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5feba06-a107-4ae3-a7fc-51c68ddb6f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5feba06-a107-4ae3-a7fc-51c68ddb6f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f5aaa9a2-c5c6-4043-b18b-adaba202465f', 'volume_name': 'volume-f5aaa9a2-c5c6-4043-b18b-adaba202465f', 'volume_size': 1, 'snapshot_id': 'c2aade1a-7fcb-4678-b9bb-dd71a037a5d9'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6717980e-5db3-45e2-87d7-1ea01b0cd64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6717980e-5db3-45e2-87d7-1ea01b0cd64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c455fe-aebf-407c-924d-fcfc7e98ce9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:27 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Volume f5aaa9a2-c5c6-4043-b18b-adaba202465f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f5aaa9a2-c5c6-4043-b18b-adaba202465f', 'volume_size': 1, 'snapshot_id': 'c2aade1a-7fcb-4678-b9bb-dd71a037a5d9'} Jul 04 00:14:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:28 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-591a189d-1ade-40f7-9ef5-60d6bb5a7df9 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084 1G" returned: 0 in 0.848s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-591a189d-1ade-40f7-9ef5-60d6bb5a7df9 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74684871-ff11-4a8a-bdc9-76829f8bbc83 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:28 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74684871-ff11-4a8a-bdc9-76829f8bbc83 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084 Jul 04 00:14:28 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:28 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-591a189d-1ade-40f7-9ef5-60d6bb5a7df9 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74684871-ff11-4a8a-bdc9-76829f8bbc83 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084" returned: 0 in 0.686s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:28 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-591a189d-1ade-40f7-9ef5-60d6bb5a7df9 tempest-ProjectReaderTests-1636517028 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084 is being set with open permissions: ugo+rw Jul 04 00:14:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-591a189d-1ade-40f7-9ef5-60d6bb5a7df9 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:28 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084 Jul 04 00:14:28 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:29 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-591a189d-1ade-40f7-9ef5-60d6bb5a7df9 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084" returned: 0 in 0.686s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-591a189d-1ade-40f7-9ef5-60d6bb5a7df9 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:29 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.info Jul 04 00:14:29 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:30 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-591a189d-1ade-40f7-9ef5-60d6bb5a7df9 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.info" returned: 0 in 0.626s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:30 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-591a189d-1ade-40f7-9ef5-60d6bb5a7df9 tempest-ProjectReaderTests-1636517028 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.info is being set with open permissions: ugo+rw Jul 04 00:14:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-591a189d-1ade-40f7-9ef5-60d6bb5a7df9 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:30 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.info Jul 04 00:14:30 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:30 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-591a189d-1ade-40f7-9ef5-60d6bb5a7df9 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.info" returned: 0 in 0.649s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-591a189d-1ade-40f7-9ef5-60d6bb5a7df9 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.344s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.065s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-497484266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7fe8c64-2354-4808-accb-e87fb40e6523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f231693e054b99979c595c4b3330f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:23Z,use_quota=True,user_id='5782e063f3004712b1e3f25076d532bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:14:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Creating volume f7fe8c64-2354-4808-accb-e87fb40e6523 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:14:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:14:30 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:14:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f7fe8c64-2354-4808-accb-e87fb40e6523 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:30 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f7fe8c64-2354-4808-accb-e87fb40e6523 1073741824 Jul 04 00:14:30 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:30 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-591a189d-1ade-40f7-9ef5-60d6bb5a7df9 tempest-ProjectReaderTests-1636517028 None] Create snapshot completed successfully Jul 04 00:14:31 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f7fe8c64-2354-4808-accb-e87fb40e6523 1073741824" returned: 0 in 0.881s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-46acd052-074e-443d-ac7a-7e0d60e27084-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] Lock "cinder-46acd052-074e-443d-ac7a-7e0d60e27084-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-quobyte-74684871-ff11-4a8a-bdc9-76829f8bbc83" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f7fe8c64-2354-4808-accb-e87fb40e6523 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-74684871-ff11-4a8a-bdc9-76829f8bbc83" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-quobyte-46acd052-074e-443d-ac7a-7e0d60e27084" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:31 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f7fe8c64-2354-4808-accb-e87fb40e6523 Jul 04 00:14:31 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-46acd052-074e-443d-ac7a-7e0d60e27084" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] Deleting offline snapshot 46acd052-074e-443d-ac7a-7e0d60e27084 of volume 74684871-ff11-4a8a-bdc9-76829f8bbc83 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:14:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] snapshot_file for this snap is: volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:14:31 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[181a2807-bd59-47d0-bc32-e527f4300938]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:31 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084 Jul 04 00:14:31 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:32 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f7fe8c64-2354-4808-accb-e87fb40e6523" returned: 0 in 0.657s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.949s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1518093641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83d3e15-819c-4371-b14a-ba2799362bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:24Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Creating volume b83d3e15-819c-4371-b14a-ba2799362bb1 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:14:32 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f45f785-3f7b-4a51-bcf5-9ba0baf6b21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7fe8c64-2354-4808-accb-e87fb40e6523', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:32 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1 1073741824 Jul 04 00:14:32 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf55c28-cb92-4bcd-b731-15dbfc82dd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:32 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Volume volume-f7fe8c64-2354-4808-accb-e87fb40e6523 (f7fe8c64-2354-4808-accb-e87fb40e6523): created successfully Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf55c28-cb92-4bcd-b731-15dbfc82dd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Flow 'volume_create_manager' (b9b96009-af3e-4a5a-9920-a9f51f0ecead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:32 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-38e85720-a196-4709-bb56-a9b983667223 tempest-ProjectReaderTests-918048902 None] Created volume successfully. Jul 04 00:14:32 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084" returned: 0 in 0.790s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74684871-ff11-4a8a-bdc9-76829f8bbc83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c30d69-868a-4844-899a-df72daa56187]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:32 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83 Jul 04 00:14:32 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] Acquiring lock "cinder-f7fe8c64-2354-4808-accb-e87fb40e6523-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] Lock "cinder-f7fe8c64-2354-4808-accb-e87fb40e6523-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] Acquiring lock "cinder-quobyte-f7fe8c64-2354-4808-accb-e87fb40e6523" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] Lock "cinder-quobyte-f7fe8c64-2354-4808-accb-e87fb40e6523" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:33 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b209a88b-190c-4bc3-9dde-1c780402ae0f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f7fe8c64-2354-4808-accb-e87fb40e6523 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:33 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f7fe8c64-2354-4808-accb-e87fb40e6523 Jul 04 00:14:33 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:33 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1 1073741824" returned: 0 in 0.975s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:14:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:33 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1 Jul 04 00:14:33 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:33 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:14:33 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:33 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83" returned: 0 in 0.900s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:33 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084 Jul 04 00:14:33 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:34 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f7fe8c64-2354-4808-accb-e87fb40e6523" returned: 0 in 0.851s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f7fe8c64-2354-4808-accb-e87fb40e6523 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:34 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f7fe8c64-2354-4808-accb-e87fb40e6523 Jul 04 00:14:34 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:34 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.732s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:14:34 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1" returned: 0 in 0.772s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.643s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Acquiring lock "cinder-quobyte-c2aade1a-7fcb-4678-b9bb-dd71a037a5d9-f5aaa9a2-c5c6-4043-b18b-adaba202465f" by "_create_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a04bf88-afa0-48e2-9655-755a9f8761c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b83d3e15-819c-4371-b14a-ba2799362bb1', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249f8a99-3592-44e2-bf25-4d9f2f569b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Lock "cinder-quobyte-c2aade1a-7fcb-4678-b9bb-dd71a037a5d9-f5aaa9a2-c5c6-4043-b18b-adaba202465f" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Creating volume f5aaa9a2-c5c6-4043-b18b-adaba202465f from snapshot c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 {{(pid=86676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Acquiring lock "cinder-quobyte-f5aaa9a2-c5c6-4043-b18b-adaba202465f" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Lock "cinder-quobyte-f5aaa9a2-c5c6-4043-b18b-adaba202465f" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] snapshot: c2aade1a-7fcb-4678-b9bb-dd71a037a5d9, volume: f5aaa9a2-c5c6-4043-b18b-adaba202465f, {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 04 00:14:34 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Volume volume-b83d3e15-819c-4371-b14a-ba2799362bb1 (b83d3e15-819c-4371-b14a-ba2799362bb1): created successfully Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249f8a99-3592-44e2-bf25-4d9f2f569b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (017685d1-d35e-43e8-8cb2-dcf33a543308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:34 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ca80325e-dbe9-48c0-879e-74c7d8cd91c9 tempest-ProjectMemberTests-119462166 None] Created volume successfully. Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ad8e6b-f0db-4453-b5a5-295020eed92c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:34 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084" returned: 0 in 0.842s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:34 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084 Jul 04 00:14:34 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:34 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 Jul 04 00:14:34 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:34 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f7fe8c64-2354-4808-accb-e87fb40e6523" returned: 0 in 0.727s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] Lock "cinder-quobyte-f7fe8c64-2354-4808-accb-e87fb40e6523" released by "delete_volume" :: held 1.627s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] Created reservations ['aaa2cb8e-4ffc-451f-ac0d-eed91202650b', 'c731acee-ab98-4a8f-a61d-3485686f797a', 'e06c9686-add8-49cf-a2e8-3550e96b1a0f', '8ec5ebd6-bf16-451c-8674-cc7703a797f6'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:34 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:14:34 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:35 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83.46acd052-074e-443d-ac7a-7e0d60e27084" returned: 0 in 0.704s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-46acd052-074e-443d-ac7a-7e0d60e27084" released by "_delete_snapshot" :: held 3.394s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-74684871-ff11-4a8a-bdc9-76829f8bbc83" released by "delete_snapshot" :: held 3.428s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-031686e9-2ec2-4ec6-a1c0-7a491e22efab tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:35 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9" returned: 0 in 0.929s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18411804-f29c-423d-8cf6-f4209a3954a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] Created reservations ['bd3968cb-8318-4f1e-9632-c81b549975f6', '2dd3e41f-2250-45c6-a679-91004b17f212', '0779584b-f289-4c20-ad3c-d48d049a5375', '048fbda7-4a95-4fd3-af92-68aa57536cc1'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5aaa7f-2585-4b3d-8897-93087c5fe0a6]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:35 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] Delete snapshot completed successfully. Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eca7b218-986c-4b02-be82-101e369280cd tempest-ProjectReaderTests-1636517028 None] Lock "cinder-46acd052-074e-443d-ac7a-7e0d60e27084-delete_snapshot" released by "delete_snapshot" :: held 3.690s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:35 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 Jul 04 00:14:35 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:35 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.791s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:14:35 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] Deleted volume successfully. Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8074313a-1e4d-49f5-93e0-7c4409e9f527 tempest-ProjectReaderTests-918048902 None] Lock "cinder-f7fe8c64-2354-4808-accb-e87fb40e6523-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Flow 'volume_create_manager' (0bf5a3bd-3f6e-4848-aa3f-a2e3a9a1f788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d8f35e2-fabf-4fd1-84fa-79c9f0cedc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d8f35e2-fabf-4fd1-84fa-79c9f0cedc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813191533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c3bf55-2de0-4083-8a6a-08420ea1052e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f231693e054b99979c595c4b3330f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:36Z,use_quota=True,user_id='5782e063f3004712b1e3f25076d532bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa9b5e7-6da7-4829-a149-e4af9b5570cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa9b5e7-6da7-4829-a149-e4af9b5570cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ce8c47-a2cb-4aca-bcbd-d9e59429baf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ce8c47-a2cb-4aca-bcbd-d9e59429baf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4c3bf55-2de0-4083-8a6a-08420ea1052e', 'volume_name': 'volume-c4c3bf55-2de0-4083-8a6a-08420ea1052e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06143b6-40be-4cf6-bf31-83d84bc13b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06143b6-40be-4cf6-bf31-83d84bc13b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1775d5f4-6c3b-4540-9657-f34d317999d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:35 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Volume c4c3bf55-2de0-4083-8a6a-08420ea1052e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4c3bf55-2de0-4083-8a6a-08420ea1052e', 'volume_size': 1} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-74684871-ff11-4a8a-bdc9-76829f8bbc83-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-74684871-ff11-4a8a-bdc9-76829f8bbc83-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-quobyte-74684871-ff11-4a8a-bdc9-76829f8bbc83" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-74684871-ff11-4a8a-bdc9-76829f8bbc83" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:36 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0275756-9a11-4078-84b4-c07d7d56754a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:36 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83 Jul 04 00:14:36 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:36 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7" returned: 0 in 0.940s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:36 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Path /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f5aaa9a2-c5c6-4043-b18b-adaba202465f not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 04 00:14:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f5aaa9a2-c5c6-4043-b18b-adaba202465f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:36 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f5aaa9a2-c5c6-4043-b18b-adaba202465f Jul 04 00:14:36 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:36 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83" returned: 0 in 0.820s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:36 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83 Jul 04 00:14:36 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:38 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-74684871-ff11-4a8a-bdc9-76829f8bbc83" returned: 0 in 1.710s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-74684871-ff11-4a8a-bdc9-76829f8bbc83" released by "delete_volume" :: held 2.614s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:38 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] Created reservations ['ad79778e-6502-43ed-8407-98ac7b9a2afb', 'f7dcce8d-2846-4f36-aa48-536e49088659', '6cdab6b1-b14a-4586-bf4a-113b46a0eabc', '3b38a2ae-48ba-4e17-9c75-c8ed7c246cb5'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:14:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:38 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:14:38 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:40 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 1.424s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:40 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:14:40 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] Deleted volume successfully. Jul 04 00:14:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-594b0b16-5f62-4124-8353-7ef6a3f44e85 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-74684871-ff11-4a8a-bdc9-76829f8bbc83-delete_volume" released by "delete_volume" :: held 4.420s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:40 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:14:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Flow 'volume_create_manager' (ef54a14f-52dd-4396-8c93-b14439002980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddb64d6-4262-4a83-8ddf-7dbf3cf71fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddb64d6-4262-4a83-8ddf-7dbf3cf71fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39789888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f64690-3a3c-4591-970c-f87fdef65db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3921c0b818405fbee8b241596fa806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:41Z,use_quota=True,user_id='41092cc2717d43a9a6a76e9cd0f386bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f04ca8-30ca-4a72-93f9-b108ac4151a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f04ca8-30ca-4a72-93f9-b108ac4151a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df609ee4-103a-436d-a752-a5887df39da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df609ee4-103a-436d-a752-a5887df39da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55f64690-3a3c-4591-970c-f87fdef65db9', 'volume_name': 'volume-55f64690-3a3c-4591-970c-f87fdef65db9', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3296e142-72b7-421f-967d-8a034f671510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3296e142-72b7-421f-967d-8a034f671510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fef2ac-db21-48d1-92f3-c04d4fec5433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:40 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Volume 55f64690-3a3c-4591-970c-f87fdef65db9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55f64690-3a3c-4591-970c-f87fdef65db9', 'volume_size': 1} Jul 04 00:14:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:41 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f5aaa9a2-c5c6-4043-b18b-adaba202465f" returned: 0 in 5.117s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:41 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[59864ebc-4dde-4a45-b9ba-4215ca002597]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:41 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 Jul 04 00:14:41 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:42 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7" returned: 0 in 0.893s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:42 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7, size 1024.00 MB, duration 5.12 sec, destination /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f5aaa9a2-c5c6-4043-b18b-adaba202465f {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 04 00:14:42 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Converted 1024.00 MB image at 200.06 MB/s Jul 04 00:14:42 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f5aaa9a2-c5c6-4043-b18b-adaba202465f is being set with open permissions: ugo+rw Jul 04 00:14:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f5aaa9a2-c5c6-4043-b18b-adaba202465f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:42 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f5aaa9a2-c5c6-4043-b18b-adaba202465f Jul 04 00:14:42 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:42 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f5aaa9a2-c5c6-4043-b18b-adaba202465f" returned: 0 in 0.618s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Lock "cinder-quobyte-f5aaa9a2-c5c6-4043-b18b-adaba202465f" released by "_copy_volume_from_snapshot" :: held 8.632s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Lock "cinder-quobyte-c2aade1a-7fcb-4678-b9bb-dd71a037a5d9-f5aaa9a2-c5c6-4043-b18b-adaba202465f" released by "_create_volume_from_snapshot" :: held 8.663s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.703s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-031686e9-2ec2-4ec6-a1c0-7a491e22efab tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.673s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-031686e9-2ec2-4ec6-a1c0-7a491e22efab tempest-ProjectMemberTests-119462166 None] Creating offline snapshot 3fa4b483-e888-4b86-b9af-2c07b8df308c of volume b83d3e15-819c-4371-b14a-ba2799362bb1 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:14:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c455fe-aebf-407c-924d-fcfc7e98ce9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5aaa9a2-c5c6-4043-b18b-adaba202465f', 'volume_size': 1, 'snapshot_id': 'c2aade1a-7fcb-4678-b9bb-dd71a037a5d9'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3fcf2f9-5c19-4073-885b-9bbab8b2056c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:42 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca6e93c-407a-459d-8de6-3e95cdc08f1c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-031686e9-2ec2-4ec6-a1c0-7a491e22efab tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:42 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Volume volume-f5aaa9a2-c5c6-4043-b18b-adaba202465f (f5aaa9a2-c5c6-4043-b18b-adaba202465f): created successfully Jul 04 00:14:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3fcf2f9-5c19-4073-885b-9bbab8b2056c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Flow 'volume_create_manager' (965f0a3e-7fbf-49b0-9160-bf57db14ac2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:42 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8583ce58-bedd-4bbb-8e88-5b6e602473db tempest-SnapshotDependencyTests-1912991502 None] Created volume successfully. Jul 04 00:14:43 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1 Jul 04 00:14:43 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] Acquiring lock "cinder-c2aade1a-7fcb-4678-b9bb-dd71a037a5d9-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] Lock "cinder-c2aade1a-7fcb-4678-b9bb-dd71a037a5d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] Acquiring lock "cinder-quobyte-18411804-f29c-423d-8cf6-f4209a3954a7" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] Lock "cinder-quobyte-18411804-f29c-423d-8cf6-f4209a3954a7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] Acquiring lock "cinder-quobyte-c2aade1a-7fcb-4678-b9bb-dd71a037a5d9" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] Lock "cinder-quobyte-c2aade1a-7fcb-4678-b9bb-dd71a037a5d9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] Deleting offline snapshot c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 of volume 18411804-f29c-423d-8cf6-f4209a3954a7 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:14:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] snapshot_file for this snap is: volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:14:43 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-031686e9-2ec2-4ec6-a1c0-7a491e22efab tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1" returned: 0 in 0.802s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-031686e9-2ec2-4ec6-a1c0-7a491e22efab tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:43 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[39db92d8-5449-4379-9651-2b9caec08120]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:43 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c 1G Jul 04 00:14:43 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:43 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 Jul 04 00:14:43 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:44 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9" returned: 0 in 0.751s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18411804-f29c-423d-8cf6-f4209a3954a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:14:44 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[757d752d-7553-4ede-95a7-a88e1102ff5f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:44 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-031686e9-2ec2-4ec6-a1c0-7a491e22efab tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c 1G" returned: 0 in 0.812s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-031686e9-2ec2-4ec6-a1c0-7a491e22efab tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83d3e15-819c-4371-b14a-ba2799362bb1 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:44 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83d3e15-819c-4371-b14a-ba2799362bb1 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c Jul 04 00:14:44 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:44 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 Jul 04 00:14:44 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:45 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7" returned: 0 in 0.769s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:45 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-031686e9-2ec2-4ec6-a1c0-7a491e22efab tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83d3e15-819c-4371-b14a-ba2799362bb1 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c" returned: 0 in 0.760s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:45 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-031686e9-2ec2-4ec6-a1c0-7a491e22efab tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c is being set with open permissions: ugo+rw Jul 04 00:14:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-031686e9-2ec2-4ec6-a1c0-7a491e22efab tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:45 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 Jul 04 00:14:45 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:45 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c Jul 04 00:14:45 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:45 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-031686e9-2ec2-4ec6-a1c0-7a491e22efab tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c" returned: 0 in 0.679s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-031686e9-2ec2-4ec6-a1c0-7a491e22efab tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:46 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9" returned: 0 in 0.752s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:46 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.info Jul 04 00:14:46 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:46 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9 Jul 04 00:14:46 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:46 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:46 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-031686e9-2ec2-4ec6-a1c0-7a491e22efab tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.info" returned: 0 in 0.659s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:46 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-031686e9-2ec2-4ec6-a1c0-7a491e22efab tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.info is being set with open permissions: ugo+rw Jul 04 00:14:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-031686e9-2ec2-4ec6-a1c0-7a491e22efab tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7.c2aade1a-7fcb-4678-b9bb-dd71a037a5d9" returned: 0 in 0.657s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:46 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.info Jul 04 00:14:46 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] Lock "cinder-quobyte-c2aade1a-7fcb-4678-b9bb-dd71a037a5d9" released by "_delete_snapshot" :: held 3.046s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] Lock "cinder-quobyte-18411804-f29c-423d-8cf6-f4209a3954a7" released by "delete_snapshot" :: held 3.070s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:46 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] Created reservations ['0435b20f-dcf0-4800-8f57-1b73d726edf2', '467082fa-5f1b-4f51-b4fa-9b736951604e', '1f165306-eb0e-4a5b-b669-9b02581c11bb', 'df33d8c1-bbc3-4c4a-a0e5-af9b87441bac'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:14:46 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] Delete snapshot completed successfully. Jul 04 00:14:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0c83ba6d-b25b-403b-8489-6b7bdd042c38 tempest-SnapshotDependencyTests-1912991502 None] Lock "cinder-c2aade1a-7fcb-4678-b9bb-dd71a037a5d9-delete_snapshot" released by "delete_snapshot" :: held 3.234s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:47 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-031686e9-2ec2-4ec6-a1c0-7a491e22efab tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.info" returned: 0 in 0.633s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-031686e9-2ec2-4ec6-a1c0-7a491e22efab tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.460s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.402s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813191533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c3bf55-2de0-4083-8a6a-08420ea1052e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f231693e054b99979c595c4b3330f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:36Z,use_quota=True,user_id='5782e063f3004712b1e3f25076d532bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:14:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Creating volume c4c3bf55-2de0-4083-8a6a-08420ea1052e {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:14:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:14:47 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:14:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c4c3bf55-2de0-4083-8a6a-08420ea1052e 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:47 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c4c3bf55-2de0-4083-8a6a-08420ea1052e 1073741824 Jul 04 00:14:47 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:47 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-031686e9-2ec2-4ec6-a1c0-7a491e22efab tempest-ProjectMemberTests-119462166 None] Create snapshot completed successfully Jul 04 00:14:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] Acquiring lock "cinder-18411804-f29c-423d-8cf6-f4209a3954a7-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-3fa4b483-e888-4b86-b9af-2c07b8df308c-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] Lock "cinder-18411804-f29c-423d-8cf6-f4209a3954a7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] Lock "cinder-3fa4b483-e888-4b86-b9af-2c07b8df308c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-b83d3e15-819c-4371-b14a-ba2799362bb1" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-b83d3e15-819c-4371-b14a-ba2799362bb1" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-3fa4b483-e888-4b86-b9af-2c07b8df308c" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] Acquiring lock "cinder-quobyte-18411804-f29c-423d-8cf6-f4209a3954a7" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-3fa4b483-e888-4b86-b9af-2c07b8df308c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] Deleting offline snapshot 3fa4b483-e888-4b86-b9af-2c07b8df308c of volume b83d3e15-819c-4371-b14a-ba2799362bb1 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] snapshot_file for this snap is: volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] Lock "cinder-quobyte-18411804-f29c-423d-8cf6-f4209a3954a7" acquired by "delete_volume" :: waited 0.038s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20c71e6-5d90-4607-becb-24f484673b33]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c62a2a6-1664-484d-8a51-61bb1a122383]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:48 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c Jul 04 00:14:48 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:48 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 Jul 04 00:14:48 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:48 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c4c3bf55-2de0-4083-8a6a-08420ea1052e 1073741824" returned: 0 in 0.913s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c4c3bf55-2de0-4083-8a6a-08420ea1052e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:48 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c4c3bf55-2de0-4083-8a6a-08420ea1052e Jul 04 00:14:48 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:48 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7" returned: 0 in 0.795s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:48 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c" returned: 0 in 0.825s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b83d3e15-819c-4371-b14a-ba2799362bb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:14:48 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7 Jul 04 00:14:48 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc38b4a1-fc6c-41c7-9499-930ccf9b4272]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:48 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c4c3bf55-2de0-4083-8a6a-08420ea1052e" returned: 0 in 0.672s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.189s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39789888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f64690-3a3c-4591-970c-f87fdef65db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3921c0b818405fbee8b241596fa806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:41Z,use_quota=True,user_id='41092cc2717d43a9a6a76e9cd0f386bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Creating volume 55f64690-3a3c-4591-970c-f87fdef65db9 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:14:48 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:14:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:49 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9 1073741824 Jul 04 00:14:49 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1775d5f4-6c3b-4540-9657-f34d317999d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4c3bf55-2de0-4083-8a6a-08420ea1052e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9e8e57-e99e-4848-8aad-0f95999987fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:49 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1 Jul 04 00:14:49 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:49 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Volume volume-c4c3bf55-2de0-4083-8a6a-08420ea1052e (c4c3bf55-2de0-4083-8a6a-08420ea1052e): created successfully Jul 04 00:14:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9e8e57-e99e-4848-8aad-0f95999987fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Flow 'volume_create_manager' (0bf5a3bd-3f6e-4848-aa3f-a2e3a9a1f788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:49 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-667e5fb3-c894-42b1-b179-8cb4da8f365b tempest-ProjectReaderTests-918048902 None] Created volume successfully. Jul 04 00:14:49 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-18411804-f29c-423d-8cf6-f4209a3954a7" returned: 0 in 0.722s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] Lock "cinder-quobyte-18411804-f29c-423d-8cf6-f4209a3954a7" released by "delete_volume" :: held 1.581s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:49 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] Created reservations ['f83481d0-8c6e-4256-b282-bc0159271dae', '2e53d2ac-96ed-43bb-8518-ca83df6278ff', '36109f56-01e4-4335-b132-5e85d9351c06', '039975d5-39b1-40c4-9226-131ca2d77297'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:14:49 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1" returned: 0 in 0.830s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:49 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c Jul 04 00:14:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:49 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:49 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:14:49 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] Acquiring lock "cinder-c4c3bf55-2de0-4083-8a6a-08420ea1052e-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] Lock "cinder-c4c3bf55-2de0-4083-8a6a-08420ea1052e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] Acquiring lock "cinder-quobyte-c4c3bf55-2de0-4083-8a6a-08420ea1052e" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] Lock "cinder-quobyte-c4c3bf55-2de0-4083-8a6a-08420ea1052e" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:50 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c93c0fa-c84c-4adc-926a-bced2f945728]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c4c3bf55-2de0-4083-8a6a-08420ea1052e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:50 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9 1073741824" returned: 0 in 1.110s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:50 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9 Jul 04 00:14:50 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:50 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c4c3bf55-2de0-4083-8a6a-08420ea1052e Jul 04 00:14:50 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] Acquiring lock "cinder-f5aaa9a2-c5c6-4043-b18b-adaba202465f-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] Lock "cinder-f5aaa9a2-c5c6-4043-b18b-adaba202465f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] Acquiring lock "cinder-quobyte-f5aaa9a2-c5c6-4043-b18b-adaba202465f" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] Lock "cinder-quobyte-f5aaa9a2-c5c6-4043-b18b-adaba202465f" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:50 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5efcbb-4a30-43f8-9b01-e17fef4e60e6]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f5aaa9a2-c5c6-4043-b18b-adaba202465f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:50 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f5aaa9a2-c5c6-4043-b18b-adaba202465f Jul 04 00:14:50 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:50 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.873s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:50 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:14:50 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] Deleted volume successfully. Jul 04 00:14:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8dcd5924-617b-4889-aaad-92cadbfed799 tempest-SnapshotDependencyTests-1912991502 None] Lock "cinder-18411804-f29c-423d-8cf6-f4209a3954a7-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:50 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c" returned: 0 in 1.078s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:50 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c Jul 04 00:14:50 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:51 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9" returned: 0 in 0.885s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fef2ac-db21-48d1-92f3-c04d4fec5433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55f64690-3a3c-4591-970c-f87fdef65db9', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f27c8d-18f7-4285-bc72-6f2a886f3199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:51 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c4c3bf55-2de0-4083-8a6a-08420ea1052e" returned: 0 in 1.078s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c4c3bf55-2de0-4083-8a6a-08420ea1052e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:51 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Volume volume-55f64690-3a3c-4591-970c-f87fdef65db9 (55f64690-3a3c-4591-970c-f87fdef65db9): created successfully Jul 04 00:14:51 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c4c3bf55-2de0-4083-8a6a-08420ea1052e Jul 04 00:14:51 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f27c8d-18f7-4285-bc72-6f2a886f3199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Flow 'volume_create_manager' (ef54a14f-52dd-4396-8c93-b14439002980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:51 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-30a1a106-144e-4dfd-a998-e1ed785c33d8 tempest-ProjectReaderTests-1636517028 None] Created volume successfully. Jul 04 00:14:51 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f5aaa9a2-c5c6-4043-b18b-adaba202465f" returned: 0 in 1.032s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f5aaa9a2-c5c6-4043-b18b-adaba202465f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:51 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f5aaa9a2-c5c6-4043-b18b-adaba202465f Jul 04 00:14:51 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b6e3d546-44fd-44f3-91d4-60f9a758d271 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b6e3d546-44fd-44f3-91d4-60f9a758d271 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b6e3d546-44fd-44f3-91d4-60f9a758d271 tempest-ProjectReaderTests-1636517028 None] Creating offline snapshot 839e24f9-1da0-4ca0-822b-26083606fb0c of volume 55f64690-3a3c-4591-970c-f87fdef65db9 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:14:51 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1.3fa4b483-e888-4b86-b9af-2c07b8df308c" returned: 0 in 0.770s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae0f88b-f6a5-4c55-9970-7963978dcfa8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6e3d546-44fd-44f3-91d4-60f9a758d271 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-3fa4b483-e888-4b86-b9af-2c07b8df308c" released by "_delete_snapshot" :: held 3.651s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-b83d3e15-819c-4371-b14a-ba2799362bb1" released by "delete_snapshot" :: held 3.692s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] Created reservations ['e108ba15-c96f-418d-94ca-179ad2126500', '4f705563-8e3b-46b8-b79f-ef4a8a895be2', '139bd7e7-96f5-40f8-8d32-c6820bb48b55', '7f9d2f16-3505-40ca-8d51-bb2215e55879'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:14:51 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9 Jul 04 00:14:51 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:51 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] Delete snapshot completed successfully. Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ee938a5c-00bd-44f0-a47e-a66b3cded54c tempest-ProjectMemberTests-119462166 None] Lock "cinder-3fa4b483-e888-4b86-b9af-2c07b8df308c-delete_snapshot" released by "delete_snapshot" :: held 3.902s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:51 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-c4c3bf55-2de0-4083-8a6a-08420ea1052e" returned: 0 in 0.756s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] Lock "cinder-quobyte-c4c3bf55-2de0-4083-8a6a-08420ea1052e" released by "delete_volume" :: held 1.890s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:51 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] Created reservations ['fef39b56-49d7-4edf-9c69-9515f857cf03', 'a5b5306d-c8b8-41bf-9c17-7167cafa29a3', 'acc6fda1-9740-4138-9fc0-e0aea49d5a2d', '0358c202-672c-4045-8b68-7992c4858352'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:52 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:14:52 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:52 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-f5aaa9a2-c5c6-4043-b18b-adaba202465f" returned: 0 in 0.774s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] Lock "cinder-quobyte-f5aaa9a2-c5c6-4043-b18b-adaba202465f" released by "delete_volume" :: held 1.878s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-b83d3e15-819c-4371-b14a-ba2799362bb1-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] Lock "cinder-b83d3e15-819c-4371-b14a-ba2799362bb1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-b83d3e15-819c-4371-b14a-ba2799362bb1" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] Created reservations ['f324e944-7eac-44f1-a807-57d15a01ced4', 'bc0d3c20-d716-4b47-a9bb-284014ddf405', '003a24c4-038c-49b5-8566-9a398037ef8b', '9f496fd7-601e-4c77-bad9-73ff83d29a49'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-b83d3e15-819c-4371-b14a-ba2799362bb1" acquired by "delete_volume" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df1d1f2-3aa1-4555-a44d-5c05944d9bfe]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:52 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6e3d546-44fd-44f3-91d4-60f9a758d271 tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9" returned: 0 in 0.903s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6e3d546-44fd-44f3-91d4-60f9a758d271 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9.839e24f9-1da0-4ca0-822b-26083606fb0c 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:52 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9.839e24f9-1da0-4ca0-822b-26083606fb0c 1G Jul 04 00:14:52 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:52 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:14:52 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:52 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1 Jul 04 00:14:52 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:52 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.931s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:52 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:14:52 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] Deleted volume successfully. Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b8de6f0d-6c5d-49c8-aba3-10f8d99dc83d tempest-ProjectReaderTests-918048902 None] Lock "cinder-c4c3bf55-2de0-4083-8a6a-08420ea1052e-delete_volume" released by "delete_volume" :: held 3.084s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Flow 'volume_create_manager' (f147c641-0138-4241-8cd1-60b964a55d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e609e775-7992-4254-9496-d02edf55cfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e609e775-7992-4254-9496-d02edf55cfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-845666952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d797b220-6eae-4834-9042-b4323a95aa74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f231693e054b99979c595c4b3330f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:53Z,use_quota=True,user_id='5782e063f3004712b1e3f25076d532bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b82a62d8-02a5-4b65-a96f-bb1e93addd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b82a62d8-02a5-4b65-a96f-bb1e93addd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0a8d13-156a-45a5-98d7-466fb3793dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0a8d13-156a-45a5-98d7-466fb3793dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd797b220-6eae-4834-9042-b4323a95aa74', 'volume_name': 'volume-d797b220-6eae-4834-9042-b4323a95aa74', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75037b24-0e8a-4028-848e-9c2693b32efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75037b24-0e8a-4028-848e-9c2693b32efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f04b6c17-c463-4705-868d-0576c52a7d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:53 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Volume d797b220-6eae-4834-9042-b4323a95aa74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d797b220-6eae-4834-9042-b4323a95aa74', 'volume_size': 1} Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:53 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.770s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:14:53 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] Deleted volume successfully. Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-25440782-badd-4962-ba7a-ed9051563b5a tempest-SnapshotDependencyTests-1912991502 None] Lock "cinder-f5aaa9a2-c5c6-4043-b18b-adaba202465f-delete_volume" released by "delete_volume" :: held 3.142s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:53 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1" returned: 0 in 0.991s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:53 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1 Jul 04 00:14:53 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:53 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6e3d546-44fd-44f3-91d4-60f9a758d271 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9.839e24f9-1da0-4ca0-822b-26083606fb0c 1G" returned: 0 in 1.124s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6e3d546-44fd-44f3-91d4-60f9a758d271 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55f64690-3a3c-4591-970c-f87fdef65db9 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9.839e24f9-1da0-4ca0-822b-26083606fb0c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:53 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55f64690-3a3c-4591-970c-f87fdef65db9 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9.839e24f9-1da0-4ca0-822b-26083606fb0c Jul 04 00:14:53 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:54 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b83d3e15-819c-4371-b14a-ba2799362bb1" returned: 0 in 0.752s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-b83d3e15-819c-4371-b14a-ba2799362bb1" released by "delete_volume" :: held 1.825s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:54 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] Created reservations ['28df8dea-b37b-416c-a6e6-5af2ae816d42', 'ac681d10-fc9a-45f4-afaa-9304ed502018', 'dfb92dff-65d0-47d2-b632-ae359e9ab1cc', 'df0cace1-e255-4777-9a4f-7e68dfe34c36'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:14:54 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6e3d546-44fd-44f3-91d4-60f9a758d271 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55f64690-3a3c-4591-970c-f87fdef65db9 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9.839e24f9-1da0-4ca0-822b-26083606fb0c" returned: 0 in 0.724s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:54 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-b6e3d546-44fd-44f3-91d4-60f9a758d271 tempest-ProjectReaderTests-1636517028 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9.839e24f9-1da0-4ca0-822b-26083606fb0c is being set with open permissions: ugo+rw Jul 04 00:14:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6e3d546-44fd-44f3-91d4-60f9a758d271 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9.839e24f9-1da0-4ca0-822b-26083606fb0c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:54 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9.839e24f9-1da0-4ca0-822b-26083606fb0c Jul 04 00:14:54 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:54 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:14:54 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:55 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:14:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (f129acda-ee1a-4129-a92a-422a8a202eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a7fbdb-a5c9-49ea-bb06-ce50b8c85d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a7fbdb-a5c9-49ea-bb06-ce50b8c85d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1816286145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1316402-11dc-4988-8d29-5f2edc636802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:55Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee27fbda-4423-4b69-adc7-ada06edbe6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee27fbda-4423-4b69-adc7-ada06edbe6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc2464b-7201-441e-886f-30abaf1fc671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc2464b-7201-441e-886f-30abaf1fc671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1316402-11dc-4988-8d29-5f2edc636802', 'volume_name': 'volume-b1316402-11dc-4988-8d29-5f2edc636802', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fcc20f4-646b-426a-a754-0af7fe979064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fcc20f4-646b-426a-a754-0af7fe979064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcfceddb-74d3-46b6-a428-88b1367241fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:55 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Volume b1316402-11dc-4988-8d29-5f2edc636802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1316402-11dc-4988-8d29-5f2edc636802', 'volume_size': 1} Jul 04 00:14:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:55 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6e3d546-44fd-44f3-91d4-60f9a758d271 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9.839e24f9-1da0-4ca0-822b-26083606fb0c" returned: 0 in 0.920s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6e3d546-44fd-44f3-91d4-60f9a758d271 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:55 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.914s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:55 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:14:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] Deleted volume successfully. Jul 04 00:14:55 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9.info Jul 04 00:14:55 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0275fcac-4efa-4038-84ab-d5c9c27d4108 tempest-ProjectMemberTests-119462166 None] Lock "cinder-b83d3e15-819c-4371-b14a-ba2799362bb1-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:56 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6e3d546-44fd-44f3-91d4-60f9a758d271 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9.info" returned: 0 in 0.701s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:56 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-b6e3d546-44fd-44f3-91d4-60f9a758d271 tempest-ProjectReaderTests-1636517028 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9.info is being set with open permissions: ugo+rw Jul 04 00:14:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6e3d546-44fd-44f3-91d4-60f9a758d271 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:56 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9.info Jul 04 00:14:56 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:56 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6e3d546-44fd-44f3-91d4-60f9a758d271 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-55f64690-3a3c-4591-970c-f87fdef65db9.info" returned: 0 in 0.788s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b6e3d546-44fd-44f3-91d4-60f9a758d271 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.272s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.750s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-845666952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d797b220-6eae-4834-9042-b4323a95aa74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f231693e054b99979c595c4b3330f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:53Z,use_quota=True,user_id='5782e063f3004712b1e3f25076d532bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:14:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Creating volume d797b220-6eae-4834-9042-b4323a95aa74 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:14:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:14:56 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:14:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d797b220-6eae-4834-9042-b4323a95aa74 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:56 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d797b220-6eae-4834-9042-b4323a95aa74 1073741824 Jul 04 00:14:56 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:56 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b6e3d546-44fd-44f3-91d4-60f9a758d271 tempest-ProjectReaderTests-1636517028 None] Create snapshot completed successfully Jul 04 00:14:57 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d797b220-6eae-4834-9042-b4323a95aa74 1073741824" returned: 0 in 0.892s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d797b220-6eae-4834-9042-b4323a95aa74 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:57 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d797b220-6eae-4834-9042-b4323a95aa74 Jul 04 00:14:57 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bc59604d-25f4-4b39-b1e5-5d118c4409c3 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-839e24f9-1da0-4ca0-822b-26083606fb0c-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bc59604d-25f4-4b39-b1e5-5d118c4409c3 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-839e24f9-1da0-4ca0-822b-26083606fb0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:57 devstack cinder-volume[86676]: INFO cinder.message.api [None req-bc59604d-25f4-4b39-b1e5-5d118c4409c3 tempest-ProjectReaderTests-1636517028 None] Creating message record for request_id = req-bc59604d-25f4-4b39-b1e5-5d118c4409c3 Jul 04 00:14:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bc59604d-25f4-4b39-b1e5-5d118c4409c3 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-839e24f9-1da0-4ca0-822b-26083606fb0c-delete_snapshot" released by "delete_snapshot" :: held 0.049s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server [None req-bc59604d-25f4-4b39-b1e5-5d118c4409c3 tempest-ProjectReaderTests-1636517028 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1352, in delete_snapshot Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server raise self.value Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1336, in delete_snapshot Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 04 00:14:58 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server Jul 04 00:14:58 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d797b220-6eae-4834-9042-b4323a95aa74" returned: 0 in 0.720s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:14:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.296s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1816286145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1316402-11dc-4988-8d29-5f2edc636802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:55Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:14:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Creating volume b1316402-11dc-4988-8d29-5f2edc636802 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:14:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:14:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:14:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:14:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:14:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:14:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:14:58 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:14:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:58 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802 1073741824 Jul 04 00:14:58 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f04b6c17-c463-4705-868d-0576c52a7d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d797b220-6eae-4834-9042-b4323a95aa74', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13d2fdf-6548-4956-8b1b-b8bad2d12fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:14:58 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Volume volume-d797b220-6eae-4834-9042-b4323a95aa74 (d797b220-6eae-4834-9042-b4323a95aa74): created successfully Jul 04 00:14:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13d2fdf-6548-4956-8b1b-b8bad2d12fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:14:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Flow 'volume_create_manager' (f147c641-0138-4241-8cd1-60b964a55d88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:14:58 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0791880c-d341-40b2-853f-7559f6073b3e tempest-ProjectReaderTests-918048902 None] Created volume successfully. Jul 04 00:14:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] Acquiring lock "cinder-d797b220-6eae-4834-9042-b4323a95aa74-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] Lock "cinder-d797b220-6eae-4834-9042-b4323a95aa74-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] Acquiring lock "cinder-quobyte-d797b220-6eae-4834-9042-b4323a95aa74" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:14:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] Lock "cinder-quobyte-d797b220-6eae-4834-9042-b4323a95aa74" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:14:59 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab497525-bf86-48ac-8a51-756277d2cf4a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:14:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d797b220-6eae-4834-9042-b4323a95aa74 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:59 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 04 00:14:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802 1073741824" returned: 0 in 0.977s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:14:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:14:59 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802 Jul 04 00:14:59 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:14:59 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d797b220-6eae-4834-9042-b4323a95aa74 Jul 04 00:14:59 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:00 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802" returned: 0 in 0.709s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:15:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:15:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcfceddb-74d3-46b6-a428-88b1367241fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1316402-11dc-4988-8d29-5f2edc636802', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:15:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b0abea0-e7c3-4b58-acb8-3a8c7790329e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:15:00 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Volume volume-b1316402-11dc-4988-8d29-5f2edc636802 (b1316402-11dc-4988-8d29-5f2edc636802): created successfully Jul 04 00:15:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b0abea0-e7c3-4b58-acb8-3a8c7790329e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:15:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (f129acda-ee1a-4129-a92a-422a8a202eb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:15:00 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d797b220-6eae-4834-9042-b4323a95aa74" returned: 0 in 0.845s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d797b220-6eae-4834-9042-b4323a95aa74 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-de135be6-cffe-4843-bd8c-b16ebe027ab4 tempest-ProjectMemberTests-119462166 None] Created volume successfully. Jul 04 00:15:00 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d797b220-6eae-4834-9042-b4323a95aa74 Jul 04 00:15:00 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5c611a97-5f61-4254-9586-9ac6d8050233 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:15:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5c611a97-5f61-4254-9586-9ac6d8050233 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:15:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-5c611a97-5f61-4254-9586-9ac6d8050233 tempest-ProjectMemberTests-119462166 None] Creating offline snapshot 9f44b188-8bf8-48ec-8f9a-db3c88522207 of volume b1316402-11dc-4988-8d29-5f2edc636802 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:15:00 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0746e50e-ba44-4a68-a1b0-3003b860ba90]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:15:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5c611a97-5f61-4254-9586-9ac6d8050233 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:00 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802 Jul 04 00:15:00 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:01 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-d797b220-6eae-4834-9042-b4323a95aa74" returned: 0 in 0.844s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] Lock "cinder-quobyte-d797b220-6eae-4834-9042-b4323a95aa74" released by "delete_volume" :: held 1.751s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:15:01 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] Created reservations ['e958cee0-90fa-4aa3-bd2f-30bfb1aeaf88', 'f6e9390a-8155-4d6a-b1d3-cd168a836c01', 'ea8bdaf5-84b1-4615-9a45-356947018b8b', '6ed43a74-7ec0-4920-b875-b702e7b360e7'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:15:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:15:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:15:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:15:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:15:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:15:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:01 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:15:01 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:01 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5c611a97-5f61-4254-9586-9ac6d8050233 tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802" returned: 0 in 0.844s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5c611a97-5f61-4254-9586-9ac6d8050233 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:01 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207 1G Jul 04 00:15:01 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:02 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.801s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:02 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:15:02 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] Deleted volume successfully. Jul 04 00:15:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-95c41ada-8b5b-4d75-a4f6-fbe80b2e8f33 tempest-ProjectReaderTests-918048902 None] Lock "cinder-d797b220-6eae-4834-9042-b4323a95aa74-delete_volume" released by "delete_volume" :: held 2.825s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:15:02 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5c611a97-5f61-4254-9586-9ac6d8050233 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207 1G" returned: 0 in 1.045s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5c611a97-5f61-4254-9586-9ac6d8050233 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1316402-11dc-4988-8d29-5f2edc636802 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:02 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1316402-11dc-4988-8d29-5f2edc636802 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207 Jul 04 00:15:02 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:03 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5c611a97-5f61-4254-9586-9ac6d8050233 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1316402-11dc-4988-8d29-5f2edc636802 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207" returned: 0 in 0.873s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:03 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-5c611a97-5f61-4254-9586-9ac6d8050233 tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207 is being set with open permissions: ugo+rw Jul 04 00:15:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5c611a97-5f61-4254-9586-9ac6d8050233 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:03 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207 Jul 04 00:15:03 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:04 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5c611a97-5f61-4254-9586-9ac6d8050233 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207" returned: 0 in 0.749s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5c611a97-5f61-4254-9586-9ac6d8050233 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:04 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.info Jul 04 00:15:04 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:04 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5c611a97-5f61-4254-9586-9ac6d8050233 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.info" returned: 0 in 0.630s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:04 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-5c611a97-5f61-4254-9586-9ac6d8050233 tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.info is being set with open permissions: ugo+rw Jul 04 00:15:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5c611a97-5f61-4254-9586-9ac6d8050233 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:04 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.info Jul 04 00:15:04 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:05 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5c611a97-5f61-4254-9586-9ac6d8050233 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.info" returned: 0 in 0.680s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5c611a97-5f61-4254-9586-9ac6d8050233 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.953s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:15:05 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5c611a97-5f61-4254-9586-9ac6d8050233 tempest-ProjectMemberTests-119462166 None] Create snapshot completed successfully Jul 04 00:15:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-9f44b188-8bf8-48ec-8f9a-db3c88522207-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:15:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] Lock "cinder-9f44b188-8bf8-48ec-8f9a-db3c88522207-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:15:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-b1316402-11dc-4988-8d29-5f2edc636802" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:15:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-b1316402-11dc-4988-8d29-5f2edc636802" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:15:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-9f44b188-8bf8-48ec-8f9a-db3c88522207" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:15:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-9f44b188-8bf8-48ec-8f9a-db3c88522207" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:15:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] Deleting offline snapshot 9f44b188-8bf8-48ec-8f9a-db3c88522207 of volume b1316402-11dc-4988-8d29-5f2edc636802 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:15:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] snapshot_file for this snap is: volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:15:05 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3f4fcc-8f1a-4350-8e0b-410aea34af3b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:15:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:06 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207 Jul 04 00:15:06 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:06 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207" returned: 0 in 0.725s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1316402-11dc-4988-8d29-5f2edc636802(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:15:06 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[713044c0-e42c-45ae-bbe8-761c8362caa4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:15:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:06 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802 Jul 04 00:15:06 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:07 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802" returned: 0 in 0.718s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:07 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207 Jul 04 00:15:07 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:08 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207" returned: 0 in 0.693s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:08 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207 Jul 04 00:15:08 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:08 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802.9f44b188-8bf8-48ec-8f9a-db3c88522207" returned: 0 in 0.687s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-9f44b188-8bf8-48ec-8f9a-db3c88522207" released by "_delete_snapshot" :: held 2.912s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:15:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-b1316402-11dc-4988-8d29-5f2edc636802" released by "delete_snapshot" :: held 2.934s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:15:08 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] Created reservations ['34319eb6-2973-4fd3-ae6e-43655cebbaca', '432e6194-40c0-463f-b054-bde8213e3891', '3226494f-a314-4fef-b571-eed912592348', '222d63d8-3fec-4846-a42e-3150ed0f16e0'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:15:08 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] Delete snapshot completed successfully. Jul 04 00:15:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-68473a1b-d7bb-41c8-b90f-edd3c5cc1c9b tempest-ProjectMemberTests-119462166 None] Lock "cinder-9f44b188-8bf8-48ec-8f9a-db3c88522207-delete_snapshot" released by "delete_snapshot" :: held 3.067s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:15:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-b1316402-11dc-4988-8d29-5f2edc636802-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:15:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] Lock "cinder-b1316402-11dc-4988-8d29-5f2edc636802-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:15:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-b1316402-11dc-4988-8d29-5f2edc636802" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:15:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-b1316402-11dc-4988-8d29-5f2edc636802" acquired by "delete_volume" :: waited 0.013s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:15:09 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6636e13d-fd5a-40ec-9506-35fec2e423fb]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:15:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:09 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802 Jul 04 00:15:09 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:09 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802" returned: 0 in 0.778s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:09 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802 Jul 04 00:15:09 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:10 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b1316402-11dc-4988-8d29-5f2edc636802" returned: 0 in 0.694s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-b1316402-11dc-4988-8d29-5f2edc636802" released by "delete_volume" :: held 1.526s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:15:10 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] Created reservations ['c8122b12-89e6-426d-b91b-6116facae7b2', '2ea2122b-0faf-449c-8344-5bf6e904eb9b', '9ab7486b-2ffd-460a-bf87-5940aea563d3', 'b5ff0e54-9302-4537-8bbe-9730e0290f6d'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:15:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:15:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:15:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:15:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:15:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:15:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:10 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:15:10 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:11 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.708s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:15:11 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] Deleted volume successfully. Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9fb689a1-2cec-401e-834e-9a9dda8d4052 tempest-ProjectMemberTests-119462166 None] Lock "cinder-b1316402-11dc-4988-8d29-5f2edc636802-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (4e924a1d-0e1e-44c3-ba81-79f2d51d0c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc62e7b-d0bf-4bee-8fcb-1d621563b3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc62e7b-d0bf-4bee-8fcb-1d621563b3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-205391642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2002f6c3-6cfa-47f7-9981-1b46f81924c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:12Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c68ad74-070f-4549-a397-755f89210ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c68ad74-070f-4549-a397-755f89210ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a06ccc-cc5a-4fe5-bcbc-0b872131c227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a06ccc-cc5a-4fe5-bcbc-0b872131c227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2002f6c3-6cfa-47f7-9981-1b46f81924c8', 'volume_name': 'volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129c9c5f-a9a8-4a2a-bb47-ebb291b4b4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129c9c5f-a9a8-4a2a-bb47-ebb291b4b4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12f26f4-e124-44f5-9609-6245b5802bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:15:11 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Volume 2002f6c3-6cfa-47f7-9981-1b46f81924c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8', 'volume_size': 1} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-205391642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2002f6c3-6cfa-47f7-9981-1b46f81924c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:12Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Creating volume 2002f6c3-6cfa-47f7-9981-1b46f81924c8 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:15:11 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:15:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:11 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8 1073741824 Jul 04 00:15:11 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:12 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8 1073741824" returned: 0 in 0.818s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:12 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8 Jul 04 00:15:12 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:13 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8" returned: 0 in 0.633s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:15:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:15:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12f26f4-e124-44f5-9609-6245b5802bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:15:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c274dd-72c1-4a25-96fa-e17afc880549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:15:13 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Volume volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8 (2002f6c3-6cfa-47f7-9981-1b46f81924c8): created successfully Jul 04 00:15:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c274dd-72c1-4a25-96fa-e17afc880549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:15:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (4e924a1d-0e1e-44c3-ba81-79f2d51d0c5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:15:13 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-06847a3d-cf99-4416-b382-d855b1e532bf tempest-ProjectMemberTests-119462166 None] Created volume successfully. Jul 04 00:15:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31d904cd-488c-4958-be6f-b85dcaa94eaf tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:15:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31d904cd-488c-4958-be6f-b85dcaa94eaf tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:15:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-31d904cd-488c-4958-be6f-b85dcaa94eaf tempest-ProjectMemberTests-119462166 None] Creating offline snapshot 2416111c-156b-4eac-89a9-bd15bbffdb21 of volume 2002f6c3-6cfa-47f7-9981-1b46f81924c8 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:15:14 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[db535be3-4d59-4188-82e7-c0809eb7e11c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:15:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31d904cd-488c-4958-be6f-b85dcaa94eaf tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:14 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8 Jul 04 00:15:14 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:14 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31d904cd-488c-4958-be6f-b85dcaa94eaf tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8" returned: 0 in 0.727s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31d904cd-488c-4958-be6f-b85dcaa94eaf tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8.2416111c-156b-4eac-89a9-bd15bbffdb21 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:14 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8.2416111c-156b-4eac-89a9-bd15bbffdb21 1G Jul 04 00:15:14 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:15 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31d904cd-488c-4958-be6f-b85dcaa94eaf tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8.2416111c-156b-4eac-89a9-bd15bbffdb21 1G" returned: 0 in 0.768s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31d904cd-488c-4958-be6f-b85dcaa94eaf tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8.2416111c-156b-4eac-89a9-bd15bbffdb21 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:15 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8.2416111c-156b-4eac-89a9-bd15bbffdb21 Jul 04 00:15:15 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:16 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31d904cd-488c-4958-be6f-b85dcaa94eaf tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8.2416111c-156b-4eac-89a9-bd15bbffdb21" returned: 0 in 0.687s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:16 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-31d904cd-488c-4958-be6f-b85dcaa94eaf tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8.2416111c-156b-4eac-89a9-bd15bbffdb21 is being set with open permissions: ugo+rw Jul 04 00:15:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31d904cd-488c-4958-be6f-b85dcaa94eaf tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8.2416111c-156b-4eac-89a9-bd15bbffdb21 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:16 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8.2416111c-156b-4eac-89a9-bd15bbffdb21 Jul 04 00:15:16 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:16 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31d904cd-488c-4958-be6f-b85dcaa94eaf tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8.2416111c-156b-4eac-89a9-bd15bbffdb21" returned: 0 in 0.636s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31d904cd-488c-4958-be6f-b85dcaa94eaf tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:16 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8.info Jul 04 00:15:16 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:17 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31d904cd-488c-4958-be6f-b85dcaa94eaf tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8.info" returned: 0 in 0.612s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:17 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-31d904cd-488c-4958-be6f-b85dcaa94eaf tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8.info is being set with open permissions: ugo+rw Jul 04 00:15:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31d904cd-488c-4958-be6f-b85dcaa94eaf tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:17 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8.info Jul 04 00:15:17 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:18 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31d904cd-488c-4958-be6f-b85dcaa94eaf tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-2002f6c3-6cfa-47f7-9981-1b46f81924c8.info" returned: 0 in 0.640s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31d904cd-488c-4958-be6f-b85dcaa94eaf tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.155s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:15:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-31d904cd-488c-4958-be6f-b85dcaa94eaf tempest-ProjectMemberTests-119462166 None] Create snapshot completed successfully Jul 04 00:15:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bbc80acc-442b-4827-a6f1-06ed5b279984 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-2416111c-156b-4eac-89a9-bd15bbffdb21-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:15:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bbc80acc-442b-4827-a6f1-06ed5b279984 tempest-ProjectMemberTests-119462166 None] Lock "cinder-2416111c-156b-4eac-89a9-bd15bbffdb21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:15:19 devstack cinder-volume[86676]: INFO cinder.message.api [None req-bbc80acc-442b-4827-a6f1-06ed5b279984 tempest-ProjectMemberTests-119462166 None] Creating message record for request_id = req-bbc80acc-442b-4827-a6f1-06ed5b279984 Jul 04 00:15:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bbc80acc-442b-4827-a6f1-06ed5b279984 tempest-ProjectMemberTests-119462166 None] Lock "cinder-2416111c-156b-4eac-89a9-bd15bbffdb21-delete_snapshot" released by "delete_snapshot" :: held 0.035s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server [None req-bbc80acc-442b-4827-a6f1-06ed5b279984 tempest-ProjectMemberTests-119462166 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1352, in delete_snapshot Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server raise self.value Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1336, in delete_snapshot Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 04 00:15:19 devstack cinder-volume[86676]: ERROR oslo_messaging.rpc.server Jul 04 00:15:28 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=87,cinder:UPDATE=117,cinder:INSERT=29,cinder:DELETE=10 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:15:29 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=83,cinder:UPDATE=115,cinder:INSERT=33,cinder:DELETE=11 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:15:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:15:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:15:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:15:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:15:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:15:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:15:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:15:33 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:15:33 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:15:34 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 04 00:15:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.647s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:15:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:15:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:15:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:15:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:16:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:16:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:16:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:16:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:16:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:16:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:16:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:16:33 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:16:33 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:16:34 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 04 00:16:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.660s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:16:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:16:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:16:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:16:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:17:11 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:17:11 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:17:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:17:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:17:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:17:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:17:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:17:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:17:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:17:33 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:17:33 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:17:34 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 04 00:17:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.646s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:17:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:17:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:17:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:17:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Flow 'volume_create_manager' (c0eac784-1747-4d9c-a06e-76adba0451e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c907595-2c24-4276-a0d1-36be06375f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c907595-2c24-4276-a0d1-36be06375f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-862799809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9732ea7-88ca-4f09-adad-237c9f567536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3921c0b818405fbee8b241596fa806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:14Z,use_quota=True,user_id='41092cc2717d43a9a6a76e9cd0f386bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d737aed7-85e1-4b71-bb8a-321363b94f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d737aed7-85e1-4b71-bb8a-321363b94f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de899d9c-56e0-434a-823c-e8e8dfd9a4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de899d9c-56e0-434a-823c-e8e8dfd9a4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9732ea7-88ca-4f09-adad-237c9f567536', 'volume_name': 'volume-b9732ea7-88ca-4f09-adad-237c9f567536', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034a729f-8dca-4c9c-9976-556faaa2f457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034a729f-8dca-4c9c-9976-556faaa2f457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b4f15e-904c-4f93-a0f8-adf206f3d25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:14 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Volume b9732ea7-88ca-4f09-adad-237c9f567536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9732ea7-88ca-4f09-adad-237c9f567536', 'volume_size': 1} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-862799809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9732ea7-88ca-4f09-adad-237c9f567536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3921c0b818405fbee8b241596fa806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:14Z,use_quota=True,user_id='41092cc2717d43a9a6a76e9cd0f386bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Creating volume b9732ea7-88ca-4f09-adad-237c9f567536 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:18:14 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:14 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536 1073741824 Jul 04 00:18:14 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:14 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536 1073741824" returned: 0 in 0.820s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:15 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536 Jul 04 00:18:15 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:15 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536" returned: 0 in 0.624s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:18:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b4f15e-904c-4f93-a0f8-adf206f3d25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9732ea7-88ca-4f09-adad-237c9f567536', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb23d02-9dd4-4892-bc84-7e52c68590ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:15 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Volume volume-b9732ea7-88ca-4f09-adad-237c9f567536 (b9732ea7-88ca-4f09-adad-237c9f567536): created successfully Jul 04 00:18:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb23d02-9dd4-4892-bc84-7e52c68590ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Flow 'volume_create_manager' (c0eac784-1747-4d9c-a06e-76adba0451e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:18:15 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ec97438c-bbf5-4c92-9285-4ce4a6be96cf tempest-ProjectReaderTests-1636517028 None] Created volume successfully. Jul 04 00:18:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5ca3bd9b-8384-429b-b438-25b4af6d1320 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5ca3bd9b-8384-429b-b438-25b4af6d1320 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-5ca3bd9b-8384-429b-b438-25b4af6d1320 tempest-ProjectReaderTests-1636517028 None] Creating offline snapshot ddf89cff-27b8-466d-882e-0acc8e457fcd of volume b9732ea7-88ca-4f09-adad-237c9f567536 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:18:16 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56b8440-2f35-4e68-a090-81b8c0268ef2]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:18:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ca3bd9b-8384-429b-b438-25b4af6d1320 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:16 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536 Jul 04 00:18:16 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:17 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ca3bd9b-8384-429b-b438-25b4af6d1320 tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536" returned: 0 in 0.756s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ca3bd9b-8384-429b-b438-25b4af6d1320 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:17 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd 1G Jul 04 00:18:17 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:17 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ca3bd9b-8384-429b-b438-25b4af6d1320 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd 1G" returned: 0 in 0.770s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ca3bd9b-8384-429b-b438-25b4af6d1320 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9732ea7-88ca-4f09-adad-237c9f567536 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:17 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9732ea7-88ca-4f09-adad-237c9f567536 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd Jul 04 00:18:17 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:18 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ca3bd9b-8384-429b-b438-25b4af6d1320 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9732ea7-88ca-4f09-adad-237c9f567536 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd" returned: 0 in 0.650s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:18 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-5ca3bd9b-8384-429b-b438-25b4af6d1320 tempest-ProjectReaderTests-1636517028 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd is being set with open permissions: ugo+rw Jul 04 00:18:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ca3bd9b-8384-429b-b438-25b4af6d1320 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:18 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd Jul 04 00:18:18 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:19 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ca3bd9b-8384-429b-b438-25b4af6d1320 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd" returned: 0 in 0.629s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ca3bd9b-8384-429b-b438-25b4af6d1320 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:19 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.info Jul 04 00:18:19 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:19 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ca3bd9b-8384-429b-b438-25b4af6d1320 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.info" returned: 0 in 0.639s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:19 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-5ca3bd9b-8384-429b-b438-25b4af6d1320 tempest-ProjectReaderTests-1636517028 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.info is being set with open permissions: ugo+rw Jul 04 00:18:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ca3bd9b-8384-429b-b438-25b4af6d1320 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:19 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.info Jul 04 00:18:19 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:20 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ca3bd9b-8384-429b-b438-25b4af6d1320 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.info" returned: 0 in 0.632s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5ca3bd9b-8384-429b-b438-25b4af6d1320 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.153s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5ca3bd9b-8384-429b-b438-25b4af6d1320 tempest-ProjectReaderTests-1636517028 None] Create snapshot completed successfully Jul 04 00:18:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-ddf89cff-27b8-466d-882e-0acc8e457fcd-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-ddf89cff-27b8-466d-882e-0acc8e457fcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-quobyte-b9732ea7-88ca-4f09-adad-237c9f567536" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-b9732ea7-88ca-4f09-adad-237c9f567536" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-quobyte-ddf89cff-27b8-466d-882e-0acc8e457fcd" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-ddf89cff-27b8-466d-882e-0acc8e457fcd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] Deleting offline snapshot ddf89cff-27b8-466d-882e-0acc8e457fcd of volume b9732ea7-88ca-4f09-adad-237c9f567536 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:18:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] snapshot_file for this snap is: volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:18:21 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31f5364-65f4-4436-bf6d-f2e015d2f78e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:18:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:21 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd Jul 04 00:18:21 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:22 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd" returned: 0 in 0.751s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9732ea7-88ca-4f09-adad-237c9f567536(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:18:22 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ca2767-3e41-49b2-b339-8e9eb31b51f8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:18:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:22 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536 Jul 04 00:18:22 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:23 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536" returned: 0 in 0.747s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:23 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd Jul 04 00:18:23 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:23 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd" returned: 0 in 0.715s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:23 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd Jul 04 00:18:23 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:24 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536.ddf89cff-27b8-466d-882e-0acc8e457fcd" returned: 0 in 0.637s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-ddf89cff-27b8-466d-882e-0acc8e457fcd" released by "_delete_snapshot" :: held 2.951s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-b9732ea7-88ca-4f09-adad-237c9f567536" released by "delete_snapshot" :: held 2.974s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:24 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] Created reservations ['955d0a39-4ec9-4a53-8126-c5af6f9fd7ce', 'd4df96c0-4ec0-4aca-a5a1-582cce02bf9f', '056abe63-306d-434a-9580-b31483b7d181', '2c960009-cf69-4484-b1e1-afb4b4c94e39'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:18:24 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] Delete snapshot completed successfully. Jul 04 00:18:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d1d9c3ac-d70c-4bc3-81ed-ac4016dfc308 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-ddf89cff-27b8-466d-882e-0acc8e457fcd-delete_snapshot" released by "delete_snapshot" :: held 3.102s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-b9732ea7-88ca-4f09-adad-237c9f567536-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-b9732ea7-88ca-4f09-adad-237c9f567536-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-quobyte-b9732ea7-88ca-4f09-adad-237c9f567536" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-b9732ea7-88ca-4f09-adad-237c9f567536" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:24 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41e5f02-ffd1-490c-962a-024eaba6d5b4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:18:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:24 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536 Jul 04 00:18:24 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:25 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536" returned: 0 in 0.783s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:25 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536 Jul 04 00:18:25 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:26 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-b9732ea7-88ca-4f09-adad-237c9f567536" returned: 0 in 0.637s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-b9732ea7-88ca-4f09-adad-237c9f567536" released by "delete_volume" :: held 1.473s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:26 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] Created reservations ['c44e8340-5b35-419f-82f5-56d3db8133e1', 'f38a7d8c-7c1f-4948-8487-fa3d2fdf29ed', 'e42d9716-ac2f-4eb1-9ba8-94178807f8f9', 'f3e2734b-7524-4477-8c1e-fe7a2b24eea4'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:18:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:18:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:18:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:26 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:18:26 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:27 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.693s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:18:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] Deleted volume successfully. Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5a8ffcf3-a16f-4ab4-af9b-f93e2fbdfa45 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-b9732ea7-88ca-4f09-adad-237c9f567536-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Flow 'volume_create_manager' (8d77fcbb-02b5-45b5-9fee-3ba475df7e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (763e4cce-db58-4719-8f90-c80d13971799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (763e4cce-db58-4719-8f90-c80d13971799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1657029035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5097ff-ec2b-4a89-aace-3c3a444919f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3921c0b818405fbee8b241596fa806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:27Z,use_quota=True,user_id='41092cc2717d43a9a6a76e9cd0f386bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfdbd0c3-b885-4a83-9bbb-d91a99ba3d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfdbd0c3-b885-4a83-9bbb-d91a99ba3d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c6239d-c34e-4930-91e5-0289daea90f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c6239d-c34e-4930-91e5-0289daea90f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da5097ff-ec2b-4a89-aace-3c3a444919f0', 'volume_name': 'volume-da5097ff-ec2b-4a89-aace-3c3a444919f0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a21012-b40b-48e7-8e20-2246b53e57a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a21012-b40b-48e7-8e20-2246b53e57a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b704e19f-c1db-408b-8336-8d6e0a4b9132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:27 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Volume da5097ff-ec2b-4a89-aace-3c3a444919f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da5097ff-ec2b-4a89-aace-3c3a444919f0', 'volume_size': 1} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1657029035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5097ff-ec2b-4a89-aace-3c3a444919f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3921c0b818405fbee8b241596fa806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:27Z,use_quota=True,user_id='41092cc2717d43a9a6a76e9cd0f386bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Creating volume da5097ff-ec2b-4a89-aace-3c3a444919f0 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:18:27 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:18:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:27 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0 1073741824 Jul 04 00:18:27 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:28 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0 1073741824" returned: 0 in 0.818s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:28 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0 Jul 04 00:18:28 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:28 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0" returned: 0 in 0.669s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:18:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b704e19f-c1db-408b-8336-8d6e0a4b9132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da5097ff-ec2b-4a89-aace-3c3a444919f0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e3c5dd-1b32-4080-8e8b-9b702e4cdde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:29 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Volume volume-da5097ff-ec2b-4a89-aace-3c3a444919f0 (da5097ff-ec2b-4a89-aace-3c3a444919f0): created successfully Jul 04 00:18:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e3c5dd-1b32-4080-8e8b-9b702e4cdde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Flow 'volume_create_manager' (8d77fcbb-02b5-45b5-9fee-3ba475df7e3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:18:29 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b0f85965-f640-420f-9863-4948f7fdd7e9 tempest-ProjectReaderTests-1636517028 None] Created volume successfully. Jul 04 00:18:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ced860a9-e5e6-468c-bdb1-b0b89d703411 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ced860a9-e5e6-468c-bdb1-b0b89d703411 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ced860a9-e5e6-468c-bdb1-b0b89d703411 tempest-ProjectReaderTests-1636517028 None] Creating offline snapshot af3b03d3-1dc8-4b16-aebb-f2bb09a017ca of volume da5097ff-ec2b-4a89-aace-3c3a444919f0 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:18:29 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f896de-2d22-48e4-9fba-0793cc3bb93d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:18:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ced860a9-e5e6-468c-bdb1-b0b89d703411 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:29 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0 Jul 04 00:18:29 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:30 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ced860a9-e5e6-468c-bdb1-b0b89d703411 tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0" returned: 0 in 0.786s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ced860a9-e5e6-468c-bdb1-b0b89d703411 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:30 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca 1G Jul 04 00:18:30 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:31 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ced860a9-e5e6-468c-bdb1-b0b89d703411 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca 1G" returned: 0 in 0.775s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ced860a9-e5e6-468c-bdb1-b0b89d703411 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da5097ff-ec2b-4a89-aace-3c3a444919f0 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:31 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da5097ff-ec2b-4a89-aace-3c3a444919f0 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca Jul 04 00:18:31 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:31 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ced860a9-e5e6-468c-bdb1-b0b89d703411 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da5097ff-ec2b-4a89-aace-3c3a444919f0 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca" returned: 0 in 0.706s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:31 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-ced860a9-e5e6-468c-bdb1-b0b89d703411 tempest-ProjectReaderTests-1636517028 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca is being set with open permissions: ugo+rw Jul 04 00:18:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ced860a9-e5e6-468c-bdb1-b0b89d703411 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:31 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca Jul 04 00:18:31 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:32 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ced860a9-e5e6-468c-bdb1-b0b89d703411 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca" returned: 0 in 0.662s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ced860a9-e5e6-468c-bdb1-b0b89d703411 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:32 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.info Jul 04 00:18:32 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:33 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ced860a9-e5e6-468c-bdb1-b0b89d703411 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.info" returned: 0 in 0.677s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:33 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-ced860a9-e5e6-468c-bdb1-b0b89d703411 tempest-ProjectReaderTests-1636517028 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.info is being set with open permissions: ugo+rw Jul 04 00:18:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ced860a9-e5e6-468c-bdb1-b0b89d703411 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:33 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.info Jul 04 00:18:33 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:18:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:18:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:18:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:33 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:18:33 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:33 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ced860a9-e5e6-468c-bdb1-b0b89d703411 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.info" returned: 0 in 0.684s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ced860a9-e5e6-468c-bdb1-b0b89d703411 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.373s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:34 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ced860a9-e5e6-468c-bdb1-b0b89d703411 tempest-ProjectReaderTests-1636517028 None] Create snapshot completed successfully Jul 04 00:18:34 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.667s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:18:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:18:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:18:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:18:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-af3b03d3-1dc8-4b16-aebb-f2bb09a017ca-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-af3b03d3-1dc8-4b16-aebb-f2bb09a017ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-quobyte-da5097ff-ec2b-4a89-aace-3c3a444919f0" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-da5097ff-ec2b-4a89-aace-3c3a444919f0" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-quobyte-af3b03d3-1dc8-4b16-aebb-f2bb09a017ca" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-af3b03d3-1dc8-4b16-aebb-f2bb09a017ca" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] Deleting offline snapshot af3b03d3-1dc8-4b16-aebb-f2bb09a017ca of volume da5097ff-ec2b-4a89-aace-3c3a444919f0 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:18:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] snapshot_file for this snap is: volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:18:34 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec26882d-b02a-479a-a102-46a9ffbacf5c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:18:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:35 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca Jul 04 00:18:35 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:35 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca" returned: 0 in 0.771s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da5097ff-ec2b-4a89-aace-3c3a444919f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:18:35 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ddeb26-4ba1-4f40-a82e-116c9eb25fe1]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:18:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:35 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0 Jul 04 00:18:35 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (1cf93362-87ac-4d34-865c-ff5487abb707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a8c155b-b67c-4edb-9e96-4313e0222b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a8c155b-b67c-4edb-9e96-4313e0222b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2135771847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d18c8d3-0115-48c7-a82b-14194ee3e1a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:36Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d62d63-5033-40bd-9f68-6092821ff692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d62d63-5033-40bd-9f68-6092821ff692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e87296-e177-4da9-936a-ccd70805e5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e87296-e177-4da9-936a-ccd70805e5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d18c8d3-0115-48c7-a82b-14194ee3e1a1', 'volume_name': 'volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c6f7a3-e212-40b6-aef3-4340bb5a750d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c6f7a3-e212-40b6-aef3-4340bb5a750d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10fe0be1-8c0b-4248-a628-2813c604c7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:36 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Volume 9d18c8d3-0115-48c7-a82b-14194ee3e1a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1', 'volume_size': 1} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2135771847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d18c8d3-0115-48c7-a82b-14194ee3e1a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:36Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Creating volume 9d18c8d3-0115-48c7-a82b-14194ee3e1a1 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:18:36 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:36 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1 1073741824 Jul 04 00:18:36 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:36 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0" returned: 0 in 0.819s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:36 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca Jul 04 00:18:36 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:37 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1 1073741824" returned: 0 in 0.831s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:37 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca" returned: 0 in 0.757s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:37 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca Jul 04 00:18:37 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:37 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1 Jul 04 00:18:37 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:37 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0.af3b03d3-1dc8-4b16-aebb-f2bb09a017ca" returned: 0 in 0.648s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-af3b03d3-1dc8-4b16-aebb-f2bb09a017ca" released by "_delete_snapshot" :: held 3.094s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-da5097ff-ec2b-4a89-aace-3c3a444919f0" released by "delete_snapshot" :: held 3.117s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:38 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1" returned: 0 in 0.705s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:18:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10fe0be1-8c0b-4248-a628-2813c604c7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdda6d5f-780c-4200-ae29-e9553874ec0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:38 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] Created reservations ['e0159a1f-2c8d-4511-81b7-b36fd68f37c7', 'a6b43461-e01e-45d3-a6c5-5743a28350c7', '0061d2a2-2c1c-4a42-8220-a55d6b306494', 'c6a110d4-4b9f-4323-aee0-603df2e752cb'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:18:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Volume volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1 (9d18c8d3-0115-48c7-a82b-14194ee3e1a1): created successfully Jul 04 00:18:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdda6d5f-780c-4200-ae29-e9553874ec0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (1cf93362-87ac-4d34-865c-ff5487abb707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:18:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d55c2e3d-ce5a-460c-8b47-42ac7dda1dcc tempest-ProjectMemberTests-119462166 None] Created volume successfully. Jul 04 00:18:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] Delete snapshot completed successfully. Jul 04 00:18:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5f8a3e4a-6938-4227-af27-ff595c57cb60 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-af3b03d3-1dc8-4b16-aebb-f2bb09a017ca-delete_snapshot" released by "delete_snapshot" :: held 3.301s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-710a3a5a-4e7a-4e4a-8a88-ec0da1ffdd61 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-710a3a5a-4e7a-4e4a-8a88-ec0da1ffdd61 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-710a3a5a-4e7a-4e4a-8a88-ec0da1ffdd61 tempest-ProjectMemberTests-119462166 None] Creating offline snapshot 0619db45-0593-43f0-912f-13e8c31408e2 of volume 9d18c8d3-0115-48c7-a82b-14194ee3e1a1 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:18:38 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da22c5a-30d2-4a1b-a268-32fd42555f49]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:18:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-710a3a5a-4e7a-4e4a-8a88-ec0da1ffdd61 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:38 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1 Jul 04 00:18:38 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-da5097ff-ec2b-4a89-aace-3c3a444919f0-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-da5097ff-ec2b-4a89-aace-3c3a444919f0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-quobyte-da5097ff-ec2b-4a89-aace-3c3a444919f0" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-da5097ff-ec2b-4a89-aace-3c3a444919f0" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:39 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7f59ab-0c51-4f4c-be0b-3304f328b219]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:18:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:39 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0 Jul 04 00:18:39 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:39 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-710a3a5a-4e7a-4e4a-8a88-ec0da1ffdd61 tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1" returned: 0 in 0.835s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-710a3a5a-4e7a-4e4a-8a88-ec0da1ffdd61 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:39 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2 1G Jul 04 00:18:39 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:40 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0" returned: 0 in 0.791s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:40 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0 Jul 04 00:18:40 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:40 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-710a3a5a-4e7a-4e4a-8a88-ec0da1ffdd61 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2 1G" returned: 0 in 0.805s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-710a3a5a-4e7a-4e4a-8a88-ec0da1ffdd61 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:40 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2 Jul 04 00:18:40 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:40 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-da5097ff-ec2b-4a89-aace-3c3a444919f0" returned: 0 in 0.729s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-da5097ff-ec2b-4a89-aace-3c3a444919f0" released by "delete_volume" :: held 1.580s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:40 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] Created reservations ['863c67c9-a633-4c3a-af1a-2e06661b45f8', '6b5a2571-1244-43d4-b9fa-da0dcc5891b6', 'e9cffe4f-3c77-4a9c-8bad-d94627f60de4', '5153a0d7-f0b6-4bc9-bc81-7f705ee7d845'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:18:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:18:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:18:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:40 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:18:40 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:40 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-710a3a5a-4e7a-4e4a-8a88-ec0da1ffdd61 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2" returned: 0 in 0.673s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:40 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-710a3a5a-4e7a-4e4a-8a88-ec0da1ffdd61 tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2 is being set with open permissions: ugo+rw Jul 04 00:18:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-710a3a5a-4e7a-4e4a-8a88-ec0da1ffdd61 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:40 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2 Jul 04 00:18:40 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:41 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.673s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:41 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:18:41 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] Deleted volume successfully. Jul 04 00:18:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5af57c9e-fd69-40cc-b92d-027bc4493824 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-da5097ff-ec2b-4a89-aace-3c3a444919f0-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:41 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-710a3a5a-4e7a-4e4a-8a88-ec0da1ffdd61 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2" returned: 0 in 0.708s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-710a3a5a-4e7a-4e4a-8a88-ec0da1ffdd61 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:41 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.info Jul 04 00:18:41 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:41 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:18:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Flow 'volume_create_manager' (9705643d-904c-42cd-999a-3187040b1a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:18:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9362cb2b-b335-41b5-9259-e3cf27af6d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9362cb2b-b335-41b5-9259-e3cf27af6d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-946100539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9167ba57-f8b9-46b5-b090-66b6362811c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3921c0b818405fbee8b241596fa806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:42Z,use_quota=True,user_id='41092cc2717d43a9a6a76e9cd0f386bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c984c0-6533-4297-9203-f3bfc9321665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c984c0-6533-4297-9203-f3bfc9321665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9cacd2-f5de-4f18-bdd1-911ac92c3f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9cacd2-f5de-4f18-bdd1-911ac92c3f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9167ba57-f8b9-46b5-b090-66b6362811c5', 'volume_name': 'volume-9167ba57-f8b9-46b5-b090-66b6362811c5', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15fa6ce5-8c06-421f-991b-5aa361dd8b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15fa6ce5-8c06-421f-991b-5aa361dd8b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d3e9d8-bdbe-4d4e-8827-9b954b5e76ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:41 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Volume 9167ba57-f8b9-46b5-b090-66b6362811c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9167ba57-f8b9-46b5-b090-66b6362811c5', 'volume_size': 1} Jul 04 00:18:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:42 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-710a3a5a-4e7a-4e4a-8a88-ec0da1ffdd61 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.info" returned: 0 in 0.664s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:42 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-710a3a5a-4e7a-4e4a-8a88-ec0da1ffdd61 tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.info is being set with open permissions: ugo+rw Jul 04 00:18:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-710a3a5a-4e7a-4e4a-8a88-ec0da1ffdd61 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:42 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.info Jul 04 00:18:42 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:43 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-710a3a5a-4e7a-4e4a-8a88-ec0da1ffdd61 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.info" returned: 0 in 0.639s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-710a3a5a-4e7a-4e4a-8a88-ec0da1ffdd61 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.416s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.042s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-946100539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9167ba57-f8b9-46b5-b090-66b6362811c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3921c0b818405fbee8b241596fa806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:42Z,use_quota=True,user_id='41092cc2717d43a9a6a76e9cd0f386bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:18:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Creating volume 9167ba57-f8b9-46b5-b090-66b6362811c5 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:18:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:18:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:18:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:18:43 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:18:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:43 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5 1073741824 Jul 04 00:18:43 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-710a3a5a-4e7a-4e4a-8a88-ec0da1ffdd61 tempest-ProjectMemberTests-119462166 None] Create snapshot completed successfully Jul 04 00:18:43 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5 1073741824" returned: 0 in 0.799s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:43 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5 Jul 04 00:18:43 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-0619db45-0593-43f0-912f-13e8c31408e2-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] Lock "cinder-0619db45-0593-43f0-912f-13e8c31408e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-9d18c8d3-0115-48c7-a82b-14194ee3e1a1" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-9d18c8d3-0115-48c7-a82b-14194ee3e1a1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-0619db45-0593-43f0-912f-13e8c31408e2" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-0619db45-0593-43f0-912f-13e8c31408e2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] Deleting offline snapshot 0619db45-0593-43f0-912f-13e8c31408e2 of volume 9d18c8d3-0115-48c7-a82b-14194ee3e1a1 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:18:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] snapshot_file for this snap is: volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:18:44 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a97c48-7833-41b5-b770-6940e9f1156f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:18:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:44 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2 Jul 04 00:18:44 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:44 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5" returned: 0 in 0.650s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:18:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d3e9d8-bdbe-4d4e-8827-9b954b5e76ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9167ba57-f8b9-46b5-b090-66b6362811c5', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431aea58-f0c9-43e6-bf85-85ea0f498f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:44 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Volume volume-9167ba57-f8b9-46b5-b090-66b6362811c5 (9167ba57-f8b9-46b5-b090-66b6362811c5): created successfully Jul 04 00:18:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431aea58-f0c9-43e6-bf85-85ea0f498f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Flow 'volume_create_manager' (9705643d-904c-42cd-999a-3187040b1a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:18:44 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-465ca255-e911-496a-9393-2b8151533b7d tempest-ProjectReaderTests-1636517028 None] Created volume successfully. Jul 04 00:18:44 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2" returned: 0 in 0.813s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:18:45 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93fae3c-cbad-4d4c-9451-76241808ad9e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:18:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4fbdb55e-fa2b-4c71-bfd1-c0a6da78819a tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4fbdb55e-fa2b-4c71-bfd1-c0a6da78819a tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-4fbdb55e-fa2b-4c71-bfd1-c0a6da78819a tempest-ProjectReaderTests-1636517028 None] Creating offline snapshot abf3c995-ec3c-4008-b9bf-6044e64d5fee of volume 9167ba57-f8b9-46b5-b090-66b6362811c5 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:18:45 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1 Jul 04 00:18:45 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:45 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5636590-4b74-4c24-bfb8-fd7d65fb2b57]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:18:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbdb55e-fa2b-4c71-bfd1-c0a6da78819a tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:45 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5 Jul 04 00:18:45 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:45 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1" returned: 0 in 0.820s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:45 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2 Jul 04 00:18:45 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:45 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbdb55e-fa2b-4c71-bfd1-c0a6da78819a tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5" returned: 0 in 0.764s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbdb55e-fa2b-4c71-bfd1-c0a6da78819a tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:45 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee 1G Jul 04 00:18:45 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:46 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2" returned: 0 in 0.801s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:46 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2 Jul 04 00:18:46 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:46 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbdb55e-fa2b-4c71-bfd1-c0a6da78819a tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee 1G" returned: 0 in 0.813s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbdb55e-fa2b-4c71-bfd1-c0a6da78819a tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9167ba57-f8b9-46b5-b090-66b6362811c5 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:46 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9167ba57-f8b9-46b5-b090-66b6362811c5 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee Jul 04 00:18:46 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:47 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1.0619db45-0593-43f0-912f-13e8c31408e2" returned: 0 in 0.718s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-0619db45-0593-43f0-912f-13e8c31408e2" released by "_delete_snapshot" :: held 3.258s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:47 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbdb55e-fa2b-4c71-bfd1-c0a6da78819a tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9167ba57-f8b9-46b5-b090-66b6362811c5 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee" returned: 0 in 0.661s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:47 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-4fbdb55e-fa2b-4c71-bfd1-c0a6da78819a tempest-ProjectReaderTests-1636517028 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee is being set with open permissions: ugo+rw Jul 04 00:18:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbdb55e-fa2b-4c71-bfd1-c0a6da78819a tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-9d18c8d3-0115-48c7-a82b-14194ee3e1a1" released by "delete_snapshot" :: held 3.292s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:47 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee Jul 04 00:18:47 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:47 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] Created reservations ['a68ef43f-5b2a-486a-8a49-10d4199e49a2', 'ac172d0a-0762-4793-a4f8-9f771f50c1e5', 'c63243b5-3964-4c44-82e1-cacf5f898f19', '3ca57ea6-8fb6-4493-a511-5b0603d75c66'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:18:47 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] Delete snapshot completed successfully. Jul 04 00:18:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b70bee64-5869-4e00-ba70-42fd088e50f4 tempest-ProjectMemberTests-119462166 None] Lock "cinder-0619db45-0593-43f0-912f-13e8c31408e2-delete_snapshot" released by "delete_snapshot" :: held 3.429s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:48 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbdb55e-fa2b-4c71-bfd1-c0a6da78819a tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee" returned: 0 in 0.686s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbdb55e-fa2b-4c71-bfd1-c0a6da78819a tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:48 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.info Jul 04 00:18:48 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-9d18c8d3-0115-48c7-a82b-14194ee3e1a1-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] Lock "cinder-9d18c8d3-0115-48c7-a82b-14194ee3e1a1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-9d18c8d3-0115-48c7-a82b-14194ee3e1a1" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-9d18c8d3-0115-48c7-a82b-14194ee3e1a1" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:48 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d595b67-909b-4815-a25d-c5a0682dbda9]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:18:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:48 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1 Jul 04 00:18:48 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:48 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbdb55e-fa2b-4c71-bfd1-c0a6da78819a tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.info" returned: 0 in 0.688s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:48 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-4fbdb55e-fa2b-4c71-bfd1-c0a6da78819a tempest-ProjectReaderTests-1636517028 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.info is being set with open permissions: ugo+rw Jul 04 00:18:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbdb55e-fa2b-4c71-bfd1-c0a6da78819a tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:48 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.info Jul 04 00:18:48 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:49 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1" returned: 0 in 0.747s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:49 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1 Jul 04 00:18:49 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:49 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbdb55e-fa2b-4c71-bfd1-c0a6da78819a tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.info" returned: 0 in 0.644s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4fbdb55e-fa2b-4c71-bfd1-c0a6da78819a tempest-ProjectReaderTests-1636517028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.347s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:49 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4fbdb55e-fa2b-4c71-bfd1-c0a6da78819a tempest-ProjectReaderTests-1636517028 None] Create snapshot completed successfully Jul 04 00:18:49 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9d18c8d3-0115-48c7-a82b-14194ee3e1a1" returned: 0 in 0.634s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-9d18c8d3-0115-48c7-a82b-14194ee3e1a1" released by "delete_volume" :: held 1.432s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:49 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] Created reservations ['5dfc407d-cadb-43d8-9b55-afa253f14eb7', '4d08bfb2-7f18-4612-b40d-9d03c72a669e', 'cf4d52c4-7759-4566-b468-b6aba8d63a76', 'f66d33bb-df3f-45e3-833d-5e049029bb73'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:18:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:18:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:18:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:49 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:18:49 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-abf3c995-ec3c-4008-b9bf-6044e64d5fee-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-abf3c995-ec3c-4008-b9bf-6044e64d5fee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-quobyte-9167ba57-f8b9-46b5-b090-66b6362811c5" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-9167ba57-f8b9-46b5-b090-66b6362811c5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-quobyte-abf3c995-ec3c-4008-b9bf-6044e64d5fee" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-abf3c995-ec3c-4008-b9bf-6044e64d5fee" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] Deleting offline snapshot abf3c995-ec3c-4008-b9bf-6044e64d5fee of volume 9167ba57-f8b9-46b5-b090-66b6362811c5 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:18:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] snapshot_file for this snap is: volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:18:50 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6330e3-84eb-4263-b881-f6422741bdfb]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:18:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:50 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee Jul 04 00:18:50 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:50 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.644s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:50 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:18:50 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] Deleted volume successfully. Jul 04 00:18:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b406b2a8-b4b8-4e12-8a6c-42ebf00d37d4 tempest-ProjectMemberTests-119462166 None] Lock "cinder-9d18c8d3-0115-48c7-a82b-14194ee3e1a1-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (29b7ca82-9773-4261-a6f5-156f4a80f8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe98014-8eeb-486c-8e71-c7378b0fc075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe98014-8eeb-486c-8e71-c7378b0fc075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17986657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37dfd026-9130-4b5e-adb0-b15295b712b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:51Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4ad11c-e109-4549-be0a-16b5e4b2f542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4ad11c-e109-4549-be0a-16b5e4b2f542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b9c8c3-884d-467b-b72f-b0cf6c8e47c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b9c8c3-884d-467b-b72f-b0cf6c8e47c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37dfd026-9130-4b5e-adb0-b15295b712b8', 'volume_name': 'volume-37dfd026-9130-4b5e-adb0-b15295b712b8', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff97bf0d-1644-48dd-88e8-fc956e27f889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff97bf0d-1644-48dd-88e8-fc956e27f889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25af1382-4ebf-48db-ae9b-efca4eb9a4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:51 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Volume 37dfd026-9130-4b5e-adb0-b15295b712b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37dfd026-9130-4b5e-adb0-b15295b712b8', 'volume_size': 1} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17986657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37dfd026-9130-4b5e-adb0-b15295b712b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:51Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Creating volume 37dfd026-9130-4b5e-adb0-b15295b712b8 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:18:51 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:51 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8 1073741824 Jul 04 00:18:51 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:51 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee" returned: 0 in 0.792s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9167ba57-f8b9-46b5-b090-66b6362811c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c071306-fc9a-4c31-80e8-ca67460d48c0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:51 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5 Jul 04 00:18:51 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:51 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8 1073741824" returned: 0 in 0.868s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:52 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8 Jul 04 00:18:52 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:52 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5" returned: 0 in 0.825s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:52 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee Jul 04 00:18:52 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:52 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8" returned: 0 in 0.637s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:18:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25af1382-4ebf-48db-ae9b-efca4eb9a4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37dfd026-9130-4b5e-adb0-b15295b712b8', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f92097e-2eee-4d52-93a8-bbec0056b327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:18:52 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Volume volume-37dfd026-9130-4b5e-adb0-b15295b712b8 (37dfd026-9130-4b5e-adb0-b15295b712b8): created successfully Jul 04 00:18:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f92097e-2eee-4d52-93a8-bbec0056b327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:18:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (29b7ca82-9773-4261-a6f5-156f4a80f8ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:18:52 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-75a1861a-940b-4ea4-8fb6-4f7612e6f2e2 tempest-ProjectMemberTests-119462166 None] Created volume successfully. Jul 04 00:18:52 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee" returned: 0 in 0.769s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:52 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee Jul 04 00:18:52 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-37d7ab82-15d2-4f94-b521-54ba617d1e78 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-37d7ab82-15d2-4f94-b521-54ba617d1e78 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-37d7ab82-15d2-4f94-b521-54ba617d1e78 tempest-ProjectMemberTests-119462166 None] Creating offline snapshot 945a4848-8aae-4e03-97ee-862061a4f1aa of volume 37dfd026-9130-4b5e-adb0-b15295b712b8 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:18:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c0a557-4fcf-4c4a-812f-54e7713d352b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:18:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-37d7ab82-15d2-4f94-b521-54ba617d1e78 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:53 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8 Jul 04 00:18:53 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:53 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5.abf3c995-ec3c-4008-b9bf-6044e64d5fee" returned: 0 in 0.696s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-abf3c995-ec3c-4008-b9bf-6044e64d5fee" released by "_delete_snapshot" :: held 3.175s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-9167ba57-f8b9-46b5-b090-66b6362811c5" released by "delete_snapshot" :: held 3.199s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:53 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] Created reservations ['e1c6a2b0-9f57-4d4b-83d0-6ded78d2871b', 'd1f93faa-1e0b-4609-9035-4715bd593ad6', '447b33e5-7660-41c7-bd64-fe505bc51612', '93d0a0a1-7740-4adc-973d-d617dd3f2abd'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:18:53 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] Delete snapshot completed successfully. Jul 04 00:18:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-64354512-1450-4684-ba3e-75386fdc9165 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-abf3c995-ec3c-4008-b9bf-6044e64d5fee-delete_snapshot" released by "delete_snapshot" :: held 3.342s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:54 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-37d7ab82-15d2-4f94-b521-54ba617d1e78 tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8" returned: 0 in 0.793s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-37d7ab82-15d2-4f94-b521-54ba617d1e78 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:54 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa 1G Jul 04 00:18:54 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-9167ba57-f8b9-46b5-b090-66b6362811c5-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-9167ba57-f8b9-46b5-b090-66b6362811c5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "cinder-quobyte-9167ba57-f8b9-46b5-b090-66b6362811c5" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-9167ba57-f8b9-46b5-b090-66b6362811c5" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:54 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9154708b-8093-4434-bd94-7d17c9308c65]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:18:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:54 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5 Jul 04 00:18:54 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:54 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-37d7ab82-15d2-4f94-b521-54ba617d1e78 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa 1G" returned: 0 in 0.839s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-37d7ab82-15d2-4f94-b521-54ba617d1e78 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37dfd026-9130-4b5e-adb0-b15295b712b8 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:54 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37dfd026-9130-4b5e-adb0-b15295b712b8 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa Jul 04 00:18:54 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:55 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5" returned: 0 in 0.816s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:55 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5 Jul 04 00:18:55 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:55 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-37d7ab82-15d2-4f94-b521-54ba617d1e78 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37dfd026-9130-4b5e-adb0-b15295b712b8 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa" returned: 0 in 0.689s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:55 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-37d7ab82-15d2-4f94-b521-54ba617d1e78 tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa is being set with open permissions: ugo+rw Jul 04 00:18:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-37d7ab82-15d2-4f94-b521-54ba617d1e78 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:55 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa Jul 04 00:18:55 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:56 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-9167ba57-f8b9-46b5-b090-66b6362811c5" returned: 0 in 0.661s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-quobyte-9167ba57-f8b9-46b5-b090-66b6362811c5" released by "delete_volume" :: held 1.533s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:56 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] Created reservations ['ec0ec0ef-ebe7-4ad8-bec2-b8c6258b4b50', '3f1b827c-27bf-48b6-a59a-d62f6f5741e3', 'c92f21a0-d687-4a5f-bb9b-484cde4d728f', '0a810ba3-8fc8-4eda-89d4-b0f1ba7e0ed1'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:18:56 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-37d7ab82-15d2-4f94-b521-54ba617d1e78 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa" returned: 0 in 0.674s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-37d7ab82-15d2-4f94-b521-54ba617d1e78 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:56 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.info Jul 04 00:18:56 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:18:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:18:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:18:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:18:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:56 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:18:56 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:56 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-37d7ab82-15d2-4f94-b521-54ba617d1e78 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.info" returned: 0 in 0.681s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:56 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-37d7ab82-15d2-4f94-b521-54ba617d1e78 tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.info is being set with open permissions: ugo+rw Jul 04 00:18:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-37d7ab82-15d2-4f94-b521-54ba617d1e78 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:57 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.info Jul 04 00:18:57 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:57 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.672s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:57 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:18:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] Deleted volume successfully. Jul 04 00:18:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c5cad3f0-620d-4381-b713-8c7233ea3045 tempest-ProjectReaderTests-1636517028 None] Lock "cinder-9167ba57-f8b9-46b5-b090-66b6362811c5-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:18:57 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-37d7ab82-15d2-4f94-b521-54ba617d1e78 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.info" returned: 0 in 0.696s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-37d7ab82-15d2-4f94-b521-54ba617d1e78 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.455s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:18:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-37d7ab82-15d2-4f94-b521-54ba617d1e78 tempest-ProjectMemberTests-119462166 None] Create snapshot completed successfully Jul 04 00:18:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-945a4848-8aae-4e03-97ee-862061a4f1aa-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] Lock "cinder-945a4848-8aae-4e03-97ee-862061a4f1aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-37dfd026-9130-4b5e-adb0-b15295b712b8" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-37dfd026-9130-4b5e-adb0-b15295b712b8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-945a4848-8aae-4e03-97ee-862061a4f1aa" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:18:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-945a4848-8aae-4e03-97ee-862061a4f1aa" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:18:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] Deleting offline snapshot 945a4848-8aae-4e03-97ee-862061a4f1aa of volume 37dfd026-9130-4b5e-adb0-b15295b712b8 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:18:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] snapshot_file for this snap is: volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:18:58 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c9bf75-8fa8-446b-8690-193195c02eef]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:18:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:58 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa Jul 04 00:18:58 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:18:59 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Jul 04 00:18:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa" returned: 0 in 0.781s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:18:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37dfd026-9130-4b5e-adb0-b15295b712b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:18:59 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9763c40-a16c-48e8-b3ff-751084406f0e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:18:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:18:59 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8 Jul 04 00:18:59 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:00 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8" returned: 0 in 0.802s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:00 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa Jul 04 00:19:00 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:01 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa" returned: 0 in 0.707s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:01 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa Jul 04 00:19:01 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:01 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8.945a4848-8aae-4e03-97ee-862061a4f1aa" returned: 0 in 0.655s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-945a4848-8aae-4e03-97ee-862061a4f1aa" released by "_delete_snapshot" :: held 3.043s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-37dfd026-9130-4b5e-adb0-b15295b712b8" released by "delete_snapshot" :: held 3.067s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:01 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] Created reservations ['9d8af15c-d93e-403e-b9f8-e7cdd9ef1bd7', '2d8842c6-1d3a-46d5-a85f-6179e5592499', 'b94c8b67-d578-49f8-91bb-8b87e635249b', '5eb1faa2-69a1-46ee-9930-940b9c77bbda'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:19:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] Delete snapshot completed successfully. Jul 04 00:19:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-106c5f80-d540-46c2-a435-db703cfa1e8f tempest-ProjectMemberTests-119462166 None] Lock "cinder-945a4848-8aae-4e03-97ee-862061a4f1aa-delete_snapshot" released by "delete_snapshot" :: held 3.219s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-37dfd026-9130-4b5e-adb0-b15295b712b8-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] Lock "cinder-37dfd026-9130-4b5e-adb0-b15295b712b8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-37dfd026-9130-4b5e-adb0-b15295b712b8" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-37dfd026-9130-4b5e-adb0-b15295b712b8" acquired by "delete_volume" :: waited 0.013s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19b885c-7127-489d-9859-f8eab534cb94]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:19:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:03 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8 Jul 04 00:19:03 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:03 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8" returned: 0 in 0.788s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:03 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8 Jul 04 00:19:03 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:04 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-37dfd026-9130-4b5e-adb0-b15295b712b8" returned: 0 in 0.673s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-37dfd026-9130-4b5e-adb0-b15295b712b8" released by "delete_volume" :: held 1.515s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:04 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] Created reservations ['6797e28a-7c88-4264-8c3a-bf03317da123', '66edb244-2664-4418-ba05-bbbd3cf91e72', '5b1da23e-a106-41f5-ac8b-6f11a2d37839', 'b01a1605-7928-4909-8498-7f0259ad8a15'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:19:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:19:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:19:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:04 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:19:04 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:05 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.731s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:19:05 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] Deleted volume successfully. Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-812f5de8-f459-480b-bb40-f4d74f99e167 tempest-ProjectMemberTests-119462166 None] Lock "cinder-37dfd026-9130-4b5e-adb0-b15295b712b8-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (01ec46bc-93f2-437c-bb9f-74b216d66acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9cb6854-51b4-4a80-9759-f3a046f77cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9cb6854-51b4-4a80-9759-f3a046f77cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-108355179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39cd7a03-379c-4753-875f-cbee6c3d0895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:19:06Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e19ff51-3b62-4955-87fb-05315f75c744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e19ff51-3b62-4955-87fb-05315f75c744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54da24e8-6bb9-416f-90f2-ca8f1eff133e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54da24e8-6bb9-416f-90f2-ca8f1eff133e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39cd7a03-379c-4753-875f-cbee6c3d0895', 'volume_name': 'volume-39cd7a03-379c-4753-875f-cbee6c3d0895', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ddeefc6-053e-440a-b472-ec8e8691a554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ddeefc6-053e-440a-b472-ec8e8691a554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4005af46-11dd-48b0-bf84-44101119f85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:05 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Volume 39cd7a03-379c-4753-875f-cbee6c3d0895: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39cd7a03-379c-4753-875f-cbee6c3d0895', 'volume_size': 1} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-108355179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39cd7a03-379c-4753-875f-cbee6c3d0895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:19:06Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Creating volume 39cd7a03-379c-4753-875f-cbee6c3d0895 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:19:05 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:19:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:05 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895 1073741824 Jul 04 00:19:05 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:06 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895 1073741824" returned: 0 in 0.839s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:06 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895 Jul 04 00:19:06 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:07 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895" returned: 0 in 0.639s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:19:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4005af46-11dd-48b0-bf84-44101119f85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39cd7a03-379c-4753-875f-cbee6c3d0895', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e179ed-3240-442e-96b5-d71c1b028494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:07 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Volume volume-39cd7a03-379c-4753-875f-cbee6c3d0895 (39cd7a03-379c-4753-875f-cbee6c3d0895): created successfully Jul 04 00:19:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e179ed-3240-442e-96b5-d71c1b028494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (01ec46bc-93f2-437c-bb9f-74b216d66acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:19:07 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ef2f8381-cd36-459c-9026-b8505477fb27 tempest-ProjectMemberTests-119462166 None] Created volume successfully. Jul 04 00:19:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a4936805-0776-42fb-b160-dd8468be574c tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a4936805-0776-42fb-b160-dd8468be574c tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-a4936805-0776-42fb-b160-dd8468be574c tempest-ProjectMemberTests-119462166 None] Creating offline snapshot 59f660ff-d5b4-48b3-8279-48e35bf7ef61 of volume 39cd7a03-379c-4753-875f-cbee6c3d0895 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:19:08 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf49da3-9774-41ee-911f-3b7f0c4f7bea]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:19:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a4936805-0776-42fb-b160-dd8468be574c tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:08 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895 Jul 04 00:19:08 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:08 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a4936805-0776-42fb-b160-dd8468be574c tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895" returned: 0 in 0.800s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a4936805-0776-42fb-b160-dd8468be574c tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:08 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61 1G Jul 04 00:19:08 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:09 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a4936805-0776-42fb-b160-dd8468be574c tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61 1G" returned: 0 in 0.835s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a4936805-0776-42fb-b160-dd8468be574c tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39cd7a03-379c-4753-875f-cbee6c3d0895 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:09 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39cd7a03-379c-4753-875f-cbee6c3d0895 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61 Jul 04 00:19:09 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:10 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a4936805-0776-42fb-b160-dd8468be574c tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39cd7a03-379c-4753-875f-cbee6c3d0895 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61" returned: 0 in 0.736s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:10 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-a4936805-0776-42fb-b160-dd8468be574c tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61 is being set with open permissions: ugo+rw Jul 04 00:19:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a4936805-0776-42fb-b160-dd8468be574c tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:10 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61 Jul 04 00:19:10 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:11 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a4936805-0776-42fb-b160-dd8468be574c tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61" returned: 0 in 0.665s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a4936805-0776-42fb-b160-dd8468be574c tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:11 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.info Jul 04 00:19:11 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:11 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a4936805-0776-42fb-b160-dd8468be574c tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.info" returned: 0 in 0.707s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:11 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-a4936805-0776-42fb-b160-dd8468be574c tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.info is being set with open permissions: ugo+rw Jul 04 00:19:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a4936805-0776-42fb-b160-dd8468be574c tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:11 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.info Jul 04 00:19:11 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:12 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a4936805-0776-42fb-b160-dd8468be574c tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.info" returned: 0 in 0.671s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a4936805-0776-42fb-b160-dd8468be574c tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.508s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:12 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=74,cinder:UPDATE=89,cinder:INSERT=27,cinder:DELETE=10 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:19:12 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=101,cinder:SELECT=76,cinder:INSERT=25,cinder:DELETE=6 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:19:12 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a4936805-0776-42fb-b160-dd8468be574c tempest-ProjectMemberTests-119462166 None] Create snapshot completed successfully Jul 04 00:19:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-59f660ff-d5b4-48b3-8279-48e35bf7ef61-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] Lock "cinder-59f660ff-d5b4-48b3-8279-48e35bf7ef61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-39cd7a03-379c-4753-875f-cbee6c3d0895" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-39cd7a03-379c-4753-875f-cbee6c3d0895" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-59f660ff-d5b4-48b3-8279-48e35bf7ef61" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-59f660ff-d5b4-48b3-8279-48e35bf7ef61" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] Deleting offline snapshot 59f660ff-d5b4-48b3-8279-48e35bf7ef61 of volume 39cd7a03-379c-4753-875f-cbee6c3d0895 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:19:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] snapshot_file for this snap is: volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:19:13 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14c2704-ca2a-4802-98c3-b59232f9b059]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:19:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:13 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61 Jul 04 00:19:13 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:14 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61" returned: 0 in 0.824s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39cd7a03-379c-4753-875f-cbee6c3d0895(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:19:14 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e86e60-7a40-4963-913d-7a0dbd5d6c53]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:19:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:14 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895 Jul 04 00:19:14 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:15 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895" returned: 0 in 0.838s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:15 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61 Jul 04 00:19:15 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:15 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61" returned: 0 in 0.726s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:15 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61 Jul 04 00:19:15 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:16 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895.59f660ff-d5b4-48b3-8279-48e35bf7ef61" returned: 0 in 0.650s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-59f660ff-d5b4-48b3-8279-48e35bf7ef61" released by "_delete_snapshot" :: held 3.126s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-39cd7a03-379c-4753-875f-cbee6c3d0895" released by "delete_snapshot" :: held 3.145s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:16 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] Created reservations ['aa7178cf-c29a-42f4-9b7f-7719e98ba17f', 'ecb11d9a-21ff-448c-a9c3-7c637392ae6a', 'd1c4e1e3-9845-4fa9-85c4-d89c2387a433', '8c41c4ff-6b87-4459-91e4-4c6a133f95dd'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:19:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] Delete snapshot completed successfully. Jul 04 00:19:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3c240b05-f3f2-4819-857c-ba1d43ecf948 tempest-ProjectMemberTests-119462166 None] Lock "cinder-59f660ff-d5b4-48b3-8279-48e35bf7ef61-delete_snapshot" released by "delete_snapshot" :: held 3.285s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-39cd7a03-379c-4753-875f-cbee6c3d0895-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] Lock "cinder-39cd7a03-379c-4753-875f-cbee6c3d0895-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-39cd7a03-379c-4753-875f-cbee6c3d0895" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-39cd7a03-379c-4753-875f-cbee6c3d0895" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:17 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5372616-b912-460a-a86c-c3cdf1500311]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:19:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:17 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895 Jul 04 00:19:17 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:18 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895" returned: 0 in 0.728s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:18 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895 Jul 04 00:19:18 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:19 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-39cd7a03-379c-4753-875f-cbee6c3d0895" returned: 0 in 0.704s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-39cd7a03-379c-4753-875f-cbee6c3d0895" released by "delete_volume" :: held 1.486s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:19 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] Created reservations ['9f74a9cd-6564-4730-b347-c24d05d84738', '3b65198a-9939-4f94-9f9f-c3a3c89eea9e', '355536a7-0871-4e06-8495-e58e9dec9d7a', '28177d94-dfb4-4fbe-8e37-e818088b29c7'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:19:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:19:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:19:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:19 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:19:19 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:19 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.622s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:19 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:19:19 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] Deleted volume successfully. Jul 04 00:19:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-47b8d00a-718c-4199-a112-12a606db6b5e tempest-ProjectMemberTests-119462166 None] Lock "cinder-39cd7a03-379c-4753-875f-cbee6c3d0895-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (8637dca9-b584-494a-bf6d-2d036966e2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aaa087f-95d6-4395-88e6-01299bc84572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aaa087f-95d6-4395-88e6-01299bc84572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1766756752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d59aeb9-6dbb-432e-b0d5-5ec50de5b194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:19:20Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81109a6-35a6-44d4-974c-ddf375e583a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81109a6-35a6-44d4-974c-ddf375e583a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4696d0c0-617b-4b55-b03b-339fe0193185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4696d0c0-617b-4b55-b03b-339fe0193185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d59aeb9-6dbb-432e-b0d5-5ec50de5b194', 'volume_name': 'volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fa4351-0c4f-4f00-ab61-bb29714d81f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fa4351-0c4f-4f00-ab61-bb29714d81f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31e6987-d9e1-456a-8599-98412ee0ea78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:20 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Volume 7d59aeb9-6dbb-432e-b0d5-5ec50de5b194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194', 'volume_size': 1} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1766756752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d59aeb9-6dbb-432e-b0d5-5ec50de5b194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:19:20Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Creating volume 7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:19:20 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:19:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:20 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 1073741824 Jul 04 00:19:20 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:21 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 1073741824" returned: 0 in 0.793s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:21 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 Jul 04 00:19:21 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:21 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194" returned: 0 in 0.614s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:19:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31e6987-d9e1-456a-8599-98412ee0ea78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7e910b-97a9-4ba4-a7a4-90b4f7c02a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:21 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Volume volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 (7d59aeb9-6dbb-432e-b0d5-5ec50de5b194): created successfully Jul 04 00:19:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7e910b-97a9-4ba4-a7a4-90b4f7c02a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (8637dca9-b584-494a-bf6d-2d036966e2b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:19:21 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-15a8ee10-2587-4dd8-8e11-4fcb80ecfb2b tempest-ProjectMemberTests-119462166 None] Created volume successfully. Jul 04 00:19:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9937c043-2dc8-4973-a7be-1a06f82108d9 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9937c043-2dc8-4973-a7be-1a06f82108d9 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9937c043-2dc8-4973-a7be-1a06f82108d9 tempest-ProjectMemberTests-119462166 None] Creating offline snapshot 856e43b9-5485-40a2-acec-4249f58df439 of volume 7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:19:22 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3a0a78-60a0-411f-b128-cabe86992c74]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:19:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9937c043-2dc8-4973-a7be-1a06f82108d9 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:22 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 Jul 04 00:19:22 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:23 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9937c043-2dc8-4973-a7be-1a06f82108d9 tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194" returned: 0 in 0.728s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9937c043-2dc8-4973-a7be-1a06f82108d9 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:23 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439 1G Jul 04 00:19:23 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:23 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9937c043-2dc8-4973-a7be-1a06f82108d9 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439 1G" returned: 0 in 0.847s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9937c043-2dc8-4973-a7be-1a06f82108d9 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:24 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439 Jul 04 00:19:24 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:24 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9937c043-2dc8-4973-a7be-1a06f82108d9 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439" returned: 0 in 0.707s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:24 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-9937c043-2dc8-4973-a7be-1a06f82108d9 tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439 is being set with open permissions: ugo+rw Jul 04 00:19:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9937c043-2dc8-4973-a7be-1a06f82108d9 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:24 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439 Jul 04 00:19:24 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:25 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9937c043-2dc8-4973-a7be-1a06f82108d9 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439" returned: 0 in 0.635s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9937c043-2dc8-4973-a7be-1a06f82108d9 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:25 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.info Jul 04 00:19:25 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:25 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9937c043-2dc8-4973-a7be-1a06f82108d9 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.info" returned: 0 in 0.612s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:25 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-9937c043-2dc8-4973-a7be-1a06f82108d9 tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.info is being set with open permissions: ugo+rw Jul 04 00:19:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9937c043-2dc8-4973-a7be-1a06f82108d9 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:26 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.info Jul 04 00:19:26 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:26 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9937c043-2dc8-4973-a7be-1a06f82108d9 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.info" returned: 0 in 0.609s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9937c043-2dc8-4973-a7be-1a06f82108d9 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.221s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:26 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9937c043-2dc8-4973-a7be-1a06f82108d9 tempest-ProjectMemberTests-119462166 None] Create snapshot completed successfully Jul 04 00:19:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-856e43b9-5485-40a2-acec-4249f58df439-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] Lock "cinder-856e43b9-5485-40a2-acec-4249f58df439-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-856e43b9-5485-40a2-acec-4249f58df439" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-856e43b9-5485-40a2-acec-4249f58df439" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] Deleting offline snapshot 856e43b9-5485-40a2-acec-4249f58df439 of volume 7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:19:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] snapshot_file for this snap is: volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:19:27 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0439df-5c1a-4743-8802-42e8adcc972d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:19:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:27 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439 Jul 04 00:19:27 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:28 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439" returned: 0 in 0.735s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:19:28 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e062631a-0ebb-4c8d-b271-b37db9f43d7e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:19:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:28 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 Jul 04 00:19:28 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:29 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194" returned: 0 in 0.738s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:29 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439 Jul 04 00:19:29 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:29 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439" returned: 0 in 0.729s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:29 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439 Jul 04 00:19:29 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:30 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194.856e43b9-5485-40a2-acec-4249f58df439" returned: 0 in 0.632s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-856e43b9-5485-40a2-acec-4249f58df439" released by "_delete_snapshot" :: held 2.923s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194" released by "delete_snapshot" :: held 2.944s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:30 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] Created reservations ['7e3d16b3-f1e3-4320-bfa6-1801598ad589', 'a351b55c-1233-47a6-bc86-2a1e5b99d451', '6c63e59b-9e14-42d5-ba45-62f83c177e8e', '68dcea5f-df0d-4430-abbe-2896810d8eba'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:19:30 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] Delete snapshot completed successfully. Jul 04 00:19:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-72383ac0-4281-4bbd-b910-7a9b10bd0a6c tempest-ProjectMemberTests-119462166 None] Lock "cinder-856e43b9-5485-40a2-acec-4249f58df439-delete_snapshot" released by "delete_snapshot" :: held 3.083s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] Lock "cinder-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194" acquired by "delete_volume" :: waited 0.013s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:30 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[09919270-80ab-4179-aad0-6b4a23760b67]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:19:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:31 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 Jul 04 00:19:31 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:31 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194" returned: 0 in 0.773s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:31 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194 Jul 04 00:19:31 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:32 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194" returned: 0 in 0.625s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194" released by "delete_volume" :: held 1.451s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:32 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] Created reservations ['42e7985c-e3a5-48ce-92ae-ad57f90def90', 'a0d13e99-1d51-462e-a4e4-b2e8f66a27fc', '1432a6d7-994c-42f3-96a9-e0f9fd3059b8', 'af14f5a1-95a5-44d8-9cc4-9acd60e36749'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:19:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:19:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:19:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:32 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:19:32 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:33 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.617s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:19:33 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] Deleted volume successfully. Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b4585152-629d-449d-8985-8ee591a409f6 tempest-ProjectMemberTests-119462166 None] Lock "cinder-7d59aeb9-6dbb-432e-b0d5-5ec50de5b194-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:33 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:19:33 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (b897fa20-5b4f-41cd-aafe-6e4f6cbcb02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38eaef78-c430-4274-9031-5640c313a57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38eaef78-c430-4274-9031-5640c313a57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-485266566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2808672-ff3f-4c14-94c2-dee0eb93700f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:19:34Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca74c5f-9ad8-4ec8-a384-21f7fd470eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca74c5f-9ad8-4ec8-a384-21f7fd470eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ffef5a0-7088-4eb8-b435-72b044e0f0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ffef5a0-7088-4eb8-b435-72b044e0f0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2808672-ff3f-4c14-94c2-dee0eb93700f', 'volume_name': 'volume-a2808672-ff3f-4c14-94c2-dee0eb93700f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9634a93f-9483-4821-bbcc-7c5e77e68f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9634a93f-9483-4821-bbcc-7c5e77e68f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443ea312-05b5-43a2-8313-2ff167745850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:33 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Volume a2808672-ff3f-4c14-94c2-dee0eb93700f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2808672-ff3f-4c14-94c2-dee0eb93700f', 'volume_size': 1} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-485266566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2808672-ff3f-4c14-94c2-dee0eb93700f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af7f6a9300e41fe8552604ecf88ea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:19:34Z,use_quota=True,user_id='15296369dfd94e6db7b7a61f05b2ceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Creating volume a2808672-ff3f-4c14-94c2-dee0eb93700f {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:19:33 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:19:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:33 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f 1073741824 Jul 04 00:19:33 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:34 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.646s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:34 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:19:34 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 04 00:19:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 04 00:19:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-83e52548-f639-411b-942d-066ad95f6b40 None None] thread info: [<_MainThread(MainThread, started 128492057378944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 04 00:19:34 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f 1073741824" returned: 0 in 0.828s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:34 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f Jul 04 00:19:34 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:35 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f" returned: 0 in 0.637s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:19:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443ea312-05b5-43a2-8313-2ff167745850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2808672-ff3f-4c14-94c2-dee0eb93700f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f34bd9-cc77-4859-b712-37df7ee8a88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:35 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Volume volume-a2808672-ff3f-4c14-94c2-dee0eb93700f (a2808672-ff3f-4c14-94c2-dee0eb93700f): created successfully Jul 04 00:19:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f34bd9-cc77-4859-b712-37df7ee8a88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Flow 'volume_create_manager' (b897fa20-5b4f-41cd-aafe-6e4f6cbcb02c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:19:35 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-31925698-30df-4b83-97ca-7853b5edac47 tempest-ProjectMemberTests-119462166 None] Created volume successfully. Jul 04 00:19:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b96bd10f-e382-4297-9b36-b4f21ba00c5a tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b96bd10f-e382-4297-9b36-b4f21ba00c5a tempest-ProjectMemberTests-119462166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b96bd10f-e382-4297-9b36-b4f21ba00c5a tempest-ProjectMemberTests-119462166 None] Creating offline snapshot 14cb3043-3725-44b8-91df-498b7c4ba602 of volume a2808672-ff3f-4c14-94c2-dee0eb93700f {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 04 00:19:35 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d1c8da-0ae2-49ad-810f-04bf6454a452]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:19:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b96bd10f-e382-4297-9b36-b4f21ba00c5a tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:35 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f Jul 04 00:19:35 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:36 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b96bd10f-e382-4297-9b36-b4f21ba00c5a tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f" returned: 0 in 0.771s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b96bd10f-e382-4297-9b36-b4f21ba00c5a tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:36 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602 1G Jul 04 00:19:36 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:37 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b96bd10f-e382-4297-9b36-b4f21ba00c5a tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602 1G" returned: 0 in 0.844s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b96bd10f-e382-4297-9b36-b4f21ba00c5a tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2808672-ff3f-4c14-94c2-dee0eb93700f -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:37 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2808672-ff3f-4c14-94c2-dee0eb93700f -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602 Jul 04 00:19:37 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:38 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b96bd10f-e382-4297-9b36-b4f21ba00c5a tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2808672-ff3f-4c14-94c2-dee0eb93700f -F qcow2 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602" returned: 0 in 0.682s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:38 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-b96bd10f-e382-4297-9b36-b4f21ba00c5a tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602 is being set with open permissions: ugo+rw Jul 04 00:19:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b96bd10f-e382-4297-9b36-b4f21ba00c5a tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:38 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602 Jul 04 00:19:38 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:38 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b96bd10f-e382-4297-9b36-b4f21ba00c5a tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602" returned: 0 in 0.701s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b96bd10f-e382-4297-9b36-b4f21ba00c5a tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:38 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.info Jul 04 00:19:38 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:39 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b96bd10f-e382-4297-9b36-b4f21ba00c5a tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.info" returned: 0 in 0.704s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:39 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-b96bd10f-e382-4297-9b36-b4f21ba00c5a tempest-ProjectMemberTests-119462166 None] /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.info is being set with open permissions: ugo+rw Jul 04 00:19:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b96bd10f-e382-4297-9b36-b4f21ba00c5a tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:39 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.info Jul 04 00:19:39 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:40 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b96bd10f-e382-4297-9b36-b4f21ba00c5a tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.info" returned: 0 in 0.626s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b96bd10f-e382-4297-9b36-b4f21ba00c5a tempest-ProjectMemberTests-119462166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.418s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:40 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b96bd10f-e382-4297-9b36-b4f21ba00c5a tempest-ProjectMemberTests-119462166 None] Create snapshot completed successfully Jul 04 00:19:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-14cb3043-3725-44b8-91df-498b7c4ba602-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] Lock "cinder-14cb3043-3725-44b8-91df-498b7c4ba602-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-a2808672-ff3f-4c14-94c2-dee0eb93700f" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-a2808672-ff3f-4c14-94c2-dee0eb93700f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-14cb3043-3725-44b8-91df-498b7c4ba602" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-14cb3043-3725-44b8-91df-498b7c4ba602" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] Deleting offline snapshot 14cb3043-3725-44b8-91df-498b7c4ba602 of volume a2808672-ff3f-4c14-94c2-dee0eb93700f {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 04 00:19:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] snapshot_file for this snap is: volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 04 00:19:41 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4d015a-7057-423b-85e3-dd3f6dbaac85]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:19:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:41 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602 Jul 04 00:19:41 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:41 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602" returned: 0 in 0.710s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2808672-ff3f-4c14-94c2-dee0eb93700f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 04 00:19:41 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7731f561-ba5a-42b2-b55f-6ce9ba5a9b86]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:19:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:42 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f Jul 04 00:19:42 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:42 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f" returned: 0 in 0.705s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:42 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602 Jul 04 00:19:42 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:43 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602" returned: 0 in 0.692s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:43 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602 Jul 04 00:19:43 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:43 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f.14cb3043-3725-44b8-91df-498b7c4ba602" returned: 0 in 0.649s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-14cb3043-3725-44b8-91df-498b7c4ba602" released by "_delete_snapshot" :: held 2.840s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-a2808672-ff3f-4c14-94c2-dee0eb93700f" released by "delete_snapshot" :: held 2.863s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:44 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] Created reservations ['37328533-e367-4d71-9ff5-89ce0f7012b5', 'd0f092bd-5828-4260-9ae2-0ce3935a036b', '10a76b66-86e8-45c5-a9f9-833d81b03959', 'a5f247b1-046e-4223-b45b-baf240abd7e6'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:19:44 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] Delete snapshot completed successfully. Jul 04 00:19:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0d48cd74-3b97-4885-beb2-82e024d5a9de tempest-ProjectMemberTests-119462166 None] Lock "cinder-14cb3043-3725-44b8-91df-498b7c4ba602-delete_snapshot" released by "delete_snapshot" :: held 2.995s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-a2808672-ff3f-4c14-94c2-dee0eb93700f-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] Lock "cinder-a2808672-ff3f-4c14-94c2-dee0eb93700f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] Acquiring lock "cinder-quobyte-a2808672-ff3f-4c14-94c2-dee0eb93700f" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-a2808672-ff3f-4c14-94c2-dee0eb93700f" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:44 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edf06fc-1f6f-4919-a4dd-d6fad8f81f12]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:19:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:44 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f Jul 04 00:19:44 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:45 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f" returned: 0 in 0.726s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:45 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f Jul 04 00:19:45 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:45 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-a2808672-ff3f-4c14-94c2-dee0eb93700f" returned: 0 in 0.629s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] Lock "cinder-quobyte-a2808672-ff3f-4c14-94c2-dee0eb93700f" released by "delete_volume" :: held 1.413s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:45 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] Created reservations ['dff8baca-db64-40d8-878e-19da8a1a01d4', '175a2852-c1f8-4978-bc7d-4bf34a8aeec7', 'fb9c156c-6beb-47c0-8ab1-88b20d9e6bd0', '1648dc54-6b89-4ba0-8a8d-dc8dca544ea3'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:19:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:19:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:19:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:45 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:19:45 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:46 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.649s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:46 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:19:46 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] Deleted volume successfully. Jul 04 00:19:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ccdeffc7-1927-415b-bbf1-2b62e8d5fae2 tempest-ProjectMemberTests-119462166 None] Lock "cinder-a2808672-ff3f-4c14-94c2-dee0eb93700f-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Flow 'volume_create_manager' (1ebc6ea5-074b-4146-9655-c7def9cab678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e636e21-724c-4fe2-9ed0-6d4a8fe0b3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e636e21-724c-4fe2-9ed0-6d4a8fe0b3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-993050132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e5c146-d4a1-4009-9ac1-9b7d2ea1c663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7dfe50ee204a97929fc9663afd5de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:19:50Z,use_quota=True,user_id='8278e3c9f0e54842b9791adfa5afa5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d16a5f-d228-45c0-9bbb-531aad2a5089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d16a5f-d228-45c0-9bbb-531aad2a5089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e076f0cb-dac9-48b9-aae8-390074323fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e076f0cb-dac9-48b9-aae8-390074323fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85e5c146-d4a1-4009-9ac1-9b7d2ea1c663', 'volume_name': 'volume-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5bb184f-ff50-4ce7-b119-631e4a37ee03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5bb184f-ff50-4ce7-b119-631e4a37ee03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cef29a5-b3d2-49a6-8e4f-7584f3de0693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:50 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Volume 85e5c146-d4a1-4009-9ac1-9b7d2ea1c663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663', 'volume_size': 1} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-993050132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e5c146-d4a1-4009-9ac1-9b7d2ea1c663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7dfe50ee204a97929fc9663afd5de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:19:50Z,use_quota=True,user_id='8278e3c9f0e54842b9791adfa5afa5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Creating volume 85e5c146-d4a1-4009-9ac1-9b7d2ea1c663 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:19:50 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:50 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663 1073741824 Jul 04 00:19:50 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:50 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663 1073741824" returned: 0 in 0.784s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:51 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663 Jul 04 00:19:51 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:51 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663" returned: 0 in 0.620s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:19:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cef29a5-b3d2-49a6-8e4f-7584f3de0693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbc02b3-b6ba-42b8-9481-a7858d327737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:51 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Volume volume-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663 (85e5c146-d4a1-4009-9ac1-9b7d2ea1c663): created successfully Jul 04 00:19:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbc02b3-b6ba-42b8-9481-a7858d327737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Flow 'volume_create_manager' (1ebc6ea5-074b-4146-9655-c7def9cab678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:19:51 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0c2086e3-25c8-4d1c-8f72-bc8ed96cdcb9 tempest-ProjectReaderTests-408170573 None] Created volume successfully. Jul 04 00:19:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] Acquiring lock "cinder-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] Lock "cinder-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] Acquiring lock "cinder-quobyte-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] Lock "cinder-quobyte-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:52 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39dfbd1-6ad6-4cd0-8fdf-f938212c75af]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:19:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:52 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663 Jul 04 00:19:52 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:53 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663" returned: 0 in 0.736s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:53 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663 Jul 04 00:19:53 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:53 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663" returned: 0 in 0.601s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] Lock "cinder-quobyte-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663" released by "delete_volume" :: held 1.375s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:53 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] Created reservations ['453463f8-5ce2-420b-ac17-956a3314b53b', 'ca8c020a-c600-40c1-8baf-dbec141b8a85', '2e479d4d-1372-4922-bb9b-45625cf54a81', '015349ba-306e-4e0d-9dd5-7213f45c1511'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:19:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:19:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:19:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:53 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:19:53 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:54 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.617s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:54 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:19:54 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] Deleted volume successfully. Jul 04 00:19:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-363073ad-5518-467d-8c7e-26df44fd8f5b tempest-ProjectReaderTests-408170573 None] Lock "cinder-85e5c146-d4a1-4009-9ac1-9b7d2ea1c663-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:54 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 04 00:19:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Flow 'volume_create_manager' (8a88bd0c-df65-4f29-b0c5-4dc8c7b63368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:19:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3b1a96-e2b3-427c-a73f-0d36461bdd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3b1a96-e2b3-427c-a73f-0d36461bdd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-518641069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7046a5e3-520d-44a7-b3b3-e5aeec2922aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7dfe50ee204a97929fc9663afd5de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:19:55Z,use_quota=True,user_id='8278e3c9f0e54842b9791adfa5afa5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b2da15-53b3-4e5b-ab6c-f59c5b026281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b2da15-53b3-4e5b-ab6c-f59c5b026281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cddb194-26a9-4ff6-8dc2-904ee7b7ddfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cddb194-26a9-4ff6-8dc2-904ee7b7ddfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7046a5e3-520d-44a7-b3b3-e5aeec2922aa', 'volume_name': 'volume-7046a5e3-520d-44a7-b3b3-e5aeec2922aa', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a047e3e-7481-4237-8da9-45dbfdd5c1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a047e3e-7481-4237-8da9-45dbfdd5c1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86594899-2a62-4aa4-9b25-762fa380b3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:55 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Volume 7046a5e3-520d-44a7-b3b3-e5aeec2922aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7046a5e3-520d-44a7-b3b3-e5aeec2922aa', 'volume_size': 1} Jul 04 00:19:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T22:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-518641069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7046a5e3-520d-44a7-b3b3-e5aeec2922aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7dfe50ee204a97929fc9663afd5de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:19:55Z,use_quota=True,user_id='8278e3c9f0e54842b9791adfa5afa5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78eff03c-8afe-46c6-be6f-db7273a27599),volume_type_id=78eff03c-8afe-46c6-be6f-db7273a27599)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 04 00:19:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Creating volume 7046a5e3-520d-44a7-b3b3-e5aeec2922aa {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 04 00:19:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:19:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:19:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Selected osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 04 00:19:55 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] casted to osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964 Jul 04 00:19:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7046a5e3-520d-44a7-b3b3-e5aeec2922aa 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:55 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7046a5e3-520d-44a7-b3b3-e5aeec2922aa 1073741824 Jul 04 00:19:55 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:55 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7046a5e3-520d-44a7-b3b3-e5aeec2922aa 1073741824" returned: 0 in 0.769s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7046a5e3-520d-44a7-b3b3-e5aeec2922aa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:55 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7046a5e3-520d-44a7-b3b3-e5aeec2922aa Jul 04 00:19:55 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:56 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7046a5e3-520d-44a7-b3b3-e5aeec2922aa" returned: 0 in 0.599s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 04 00:19:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86594899-2a62-4aa4-9b25-762fa380b3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7046a5e3-520d-44a7-b3b3-e5aeec2922aa', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b167d5-7add-4067-8529-50a4a2024088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 04 00:19:56 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Volume volume-7046a5e3-520d-44a7-b3b3-e5aeec2922aa (7046a5e3-520d-44a7-b3b3-e5aeec2922aa): created successfully Jul 04 00:19:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b167d5-7add-4067-8529-50a4a2024088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 04 00:19:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Flow 'volume_create_manager' (8a88bd0c-df65-4f29-b0c5-4dc8c7b63368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 04 00:19:56 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-928f064c-0276-40dc-a4ea-0fe0d69edca9 tempest-ProjectReaderTests-408170573 None] Created volume successfully. Jul 04 00:19:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] Acquiring lock "cinder-7046a5e3-520d-44a7-b3b3-e5aeec2922aa-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] Lock "cinder-7046a5e3-520d-44a7-b3b3-e5aeec2922aa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] Acquiring lock "cinder-quobyte-7046a5e3-520d-44a7-b3b3-e5aeec2922aa" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 04 00:19:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] Lock "cinder-quobyte-7046a5e3-520d-44a7-b3b3-e5aeec2922aa" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 04 00:19:57 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72a5ad6-ac3a-4244-b224-a13b3a37abb4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 04 00:19:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7046a5e3-520d-44a7-b3b3-e5aeec2922aa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:57 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7046a5e3-520d-44a7-b3b3-e5aeec2922aa Jul 04 00:19:57 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:57 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7046a5e3-520d-44a7-b3b3-e5aeec2922aa" returned: 0 in 0.710s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7046a5e3-520d-44a7-b3b3-e5aeec2922aa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:57 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7046a5e3-520d-44a7-b3b3-e5aeec2922aa Jul 04 00:19:57 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:58 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d/volume-7046a5e3-520d-44a7-b3b3-e5aeec2922aa" returned: 0 in 0.626s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] Lock "cinder-quobyte-7046a5e3-520d-44a7-b3b3-e5aeec2922aa" released by "delete_volume" :: held 1.374s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:19:58 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] Created reservations ['bdc3f7dc-a5cb-48ed-a678-a9a02fc9185b', '7ebd9018-3062-45be-8edf-51f59eca9894', 'd09aafbd-d28c-4f3f-b322-bf5b66505ab8', 'fa2339b4-372c-46f5-bdc3-4f7899df753f'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 04 00:19:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 04 00:19:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 04 00:19:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 04 00:19:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bdc47de-bae6-4145-8f59-d1ca43d96964'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 04 00:19:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 04 00:19:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 04 00:19:58 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d Jul 04 00:19:58 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 04 00:19:59 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Jul 04 00:19:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4ce7161ea5968bbcaace25a961b9f2d" returned: 0 in 0.621s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 04 00:19:59 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 04 00:19:59 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] Deleted volume successfully. Jul 04 00:19:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5ae6b5cf-d154-407c-a167-ce1bc4cfa6f3 tempest-ProjectReaderTests-408170573 None] Lock "cinder-7046a5e3-520d-44a7-b3b3-e5aeec2922aa-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 04 00:20:08 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=46,cinder:INSERT=20,cinder:UPDATE=70,cinder:DELETE=6 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 04 00:20:09 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:DELETE=6,cinder:SELECT=57,cinder:INSERT=18,cinder:UPDATE=73 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}